-- Logs begin at Sun 2022-10-23 00:10:37 UTC, end at Sun 2022-10-23 01:16:23 UTC. -- Oct 23 00:47:13.507083 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@q-agt.service. Oct 23 00:47:16.150647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.common.config [-] Logging enabled! Oct 23 00:47:16.151254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.common.config [-] /usr/local/bin/neutron-openvswitch-agent version 21.1.0.dev93 Oct 23 00:47:16.151442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=105573) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} Oct 23 00:47:16.152240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO os_ken.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp Oct 23 00:47:16.644077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO keyring.backend [-] Loading KWallet Oct 23 00:47:16.652499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO keyring.backend [-] Loading SecretService Oct 23 00:47:16.657426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO keyring.backend [-] Loading Windows Oct 23 00:47:16.658576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO keyring.backend [-] Loading chainer Oct 23 00:47:16.659240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO keyring.backend [-] Loading macOS Oct 23 00:47:17.308424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.309093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.309093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.310355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.310620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.310876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.365527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.366208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.366675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.378443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.378976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.379485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.401869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.402482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.402958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.437103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.437706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.438191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.601506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Oct 23 00:47:17.602877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO os_ken.base.app_manager [-] loading app os_ken.app.ofctl.service Oct 23 00:47:17.604069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Oct 23 00:47:17.604754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO os_ken.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp of OVSNeutronAgentOSKenApp Oct 23 00:47:17.605430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO os_ken.base.app_manager [-] instantiating app os_ken.controller.ofp_handler of OFPHandler Oct 23 00:47:17.607274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO os_ken.base.app_manager [-] instantiating app os_ken.app.ofctl.service of OfctlService Oct 23 00:47:17.608765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: Open vSwitch agent after_init 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:17.610145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.agent_extensions_manager [-] Loaded agent extensions: [] Oct 23 00:47:17.610653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:47:17.611055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Configuration options gathered from: {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:47:17.611462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:47:17.611937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:47:17.612319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ================================================================================ {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:47:17.612860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent_down_time = 75 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.613321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] allow_bulk = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.613782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_extensions_path = {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.614235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_paste_config = api-paste.ini {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.614705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] auth_strategy = keystone {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.615164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] backlog = 4096 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.615611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.616154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_host = 0.0.0.0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.616682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_port = 9696 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.617244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] client_socket_timeout = 900 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.617695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_dir = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.618109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.618562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_source = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.619024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] control_exchange = neutron {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.619481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] core_plugin = ml2 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.619943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] debug = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.620581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_availability_zones = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.621274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.621758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_agent_notification = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.622315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_lease_duration = 86400 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.622794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_load_type = networks {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.623255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dns_domain = openstacklocal {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.623693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_new_agents = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.624135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_traditional_dhcp = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.624575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] external_dns_driver = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.625061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] filter_validation = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.625523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] global_physnet_mtu = 1500 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.626033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] host = dv-cinder-master-3-iscsi {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.626478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] http_retries = 3 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.626935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_format = [instance: %(uuid)s] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.627380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.627842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipam_driver = internal {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.628296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipv6_pd_enabled = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.628762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_config_append = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.629225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.629666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_dir = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.630162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_file = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.630596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval = 1 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.631044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval_type = days {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.631613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotation_type = none {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.632252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.632651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.633092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.633546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.633995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.634442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_dns_nameservers = 5 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.635222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_header_line = 16384 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.635678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_count = 30 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.636114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_size_mb = 200 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.636559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_subnet_host_routes = 20 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.637016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] network_link_prefix = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.637462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_data_changes = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.637924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_status_changes = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.638383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] pagination_max_limit = -1 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.638814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] publish_errors = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.639250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_burst = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.639705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_except_level = CRITICAL {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.640185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_interval = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.640641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] retry_until_window = 30 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.641111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_resources_processing_step = 20 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.641551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_response_max_timeout = 600 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.641986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] send_events_interval = 2 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.642450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.642927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] setproctitle = on {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.643378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] state_path = /opt/stack/data/neutron {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.643844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] syslog_log_facility = LOG_USER {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.644286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] tcp_keepidle = 600 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.644761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] transport_url = **** {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.645219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_eventlog = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.645663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_journal = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.646095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_json = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.646603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_ssl = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.647101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_stderr = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.647547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_syslog = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.647999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] vlan_transparent = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.648430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] watch_log_file = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.648910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_default_pool_size = 100 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.649342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_keep_alive = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.649817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.650250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_server_debug = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:47:17.650707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.651174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.651643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.connection_string = messaging:// {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.652094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.enabled = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.652551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_doc_type = notification {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.653023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_size = 10000 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.653473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_time = 2m {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.653943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.filter_error_trace = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.654403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.hmac_keys = SECRET_KEY {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.654851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.sentinel_service_name = mymaster {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.655311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.socket_timeout = 0.1 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.655746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.trace_sqlalchemy = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.656216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_new_defaults = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.656675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_scope = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.657182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_default_rule = default {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.657667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.658141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.658594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.659055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.659489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.659921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.660356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.660826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.661280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.661725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.662173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.664671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.665185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.665674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.arp_responder = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.666138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.baremetal_smartnic = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.666777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dont_fragment = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.667224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.drop_flows_on_start = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.667665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.668105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp_inherit = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.668562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.enable_distributed_routing = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.669017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.explicitly_egress_direct = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.669457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.l2_population = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.669911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.log_agent_heartbeats = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.670346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.minimize_polling = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.670810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.ovsdb_monitor_respawn_interval = 30 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.671249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.polling_interval = 2 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.671714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.quitting_rpc_timeout = 10 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.672172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.report_interval = 30.0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.672629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.674207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.674687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_csum = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.675167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_types = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.675611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.676067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.veth_mtu = 9000 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.676514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.vxlan_udp_port = 4789 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.677099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.677442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mappings = ['physnet1:br-data'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.677785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.datapath_type = system {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.678105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.igmp_snooping_enable = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.678497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.678834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.integration_bridge = br-int {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.679151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.local_ip = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.679470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_connect_timeout = 300 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.679785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_inactivity_probe = 10 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.680123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.680435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_port = 6633 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.680711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_request_timeout = 300 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.681077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.openflow_processed_per_port = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.681412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.681722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_debug = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.682043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_timeout = 10 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.682365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.682668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.682988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.683344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.683697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.684017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.684330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.684635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_ca_cert_file = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.684993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_cert_file = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.685304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_key_file = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.685624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.685943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tunnel_bridge = br-tun {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.686259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.686578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_rebinding_time = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.686892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_renewal_time = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.687196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.enable_ipv6 = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.687508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] LOCAL_IP.static_nat = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.687820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_section = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.688142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_type = password {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.688471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.688886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.certfile = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.689194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.collect_timing = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.689523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.endpoint_type = public {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.689832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.insecure = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.690132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.keyfile = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.690449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.region_name = RegionOne {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.690757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.split_loggers = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.691061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.timeout = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.691367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_section = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.691687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_type = password {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.692020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.692319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.certfile = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.692625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.collect_timing = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.692979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.endpoint_type = public {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.693280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.insecure = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.693579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.keyfile = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.693941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.region_name = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.694254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.split_loggers = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.694553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.timeout = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.694866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_section = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.695178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_type = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.695474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.cafile = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.695785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.certfile = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.696087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.collect_timing = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.696391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retries = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.696692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retry_delay = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.697033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.enable_notifications = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.697331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.endpoint_override = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.697633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.insecure = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.697931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.interface = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.698227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.keyfile = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.698522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.max_version = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.698818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.min_version = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.699124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.region_name = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.699425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_name = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.699722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_type = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.700022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.split_loggers = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.700320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retries = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.700616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retry_delay = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.700887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.timeout = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.701214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.valid_interfaces = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.701514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.version = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.701828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] cli_script.dry_run = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.702157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.702472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.702777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.703079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.703380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.703687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.703996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.704330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.704608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.704951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.705279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.705594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.705909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.706233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.706542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.706861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.707159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.707470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.707774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.708079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.708383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.708698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.709033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.709341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.709688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.709998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.710316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.710627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.710925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.711246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.711566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.711883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.driver = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.712186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.712522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.712850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.713223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.713484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.group = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.713784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.helper_command = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.714099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.714406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.thread_pool_size = 4 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.714704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.user = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.715016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.715346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.group = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.715609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.helper_command = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.715914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.716216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.716529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.user = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.716864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.717159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.group = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.717454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.717763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.718063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.718357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.user = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.718665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.capabilities = [21] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.718961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.group = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.719256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.helper_command = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.719560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.719866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.thread_pool_size = 4 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.720172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.user = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.720489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.capabilities = [12] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.723656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.group = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.723656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.helper_command = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.723656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.723656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.thread_pool_size = 4 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.723656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.user = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.723656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.capabilities = [12, 21] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.723656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.group = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.helper_command = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.thread_pool_size = 4 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.user = None {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_providers.service_provider = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent.extensions = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.default_quota = -1 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_network = 100 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.724786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_port = 500 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.726133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_rbac_policy = 10 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.726133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group = 100 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.726133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.726133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_subnet = 100 {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.728364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.track_quota_usage = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.728364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_ipset = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.728364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_security_group = True {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.728364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.728364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:47:17.728364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=105573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:47:17.802100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Flow_Table.name {{(pid=105573) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Oct 23 00:47:17.802258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Mirror.name {{(pid=105573) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Oct 23 00:47:17.802444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=105573) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 23 00:47:17.802816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=105573) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 23 00:47:17.803101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=105573) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 23 00:47:17.803391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Manager.target {{(pid=105573) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 23 00:47:17.872469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-int, may_exist=True, datapath_type=system) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:17.872885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow14', 'OpenFlow13', 'OpenFlow10')) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:17.873674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:17.879602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-int, mode=secure) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:17.885836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'disable-in-band': 'true'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:17.891030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-int. {{(pid=105573) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:103}} Oct 23 00:47:17.891666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-int, targets=['tcp:127.0.0.1:6633']) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:18.901987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=256a9734-4229-455f-985a-a0250ad16f21, col_values=(('inactivity_probe', 10000),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:18.909620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('mcast_snooping_enable', False),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:18.910354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mcast-snooping-disable-flood-unregistered': 'false'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:18.926693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-int has datapath-ID 000026ffe6eafa44 Oct 23 00:47:18.929880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xf13037a5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=23) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.932320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf13037a7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.935121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf13037a9,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=59) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.938231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xf13037ab,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=60) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.942337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xf13037ad,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=24) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.947923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf13037af,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'vlan_vid': 8191}),out_group=0,out_port=0,priority=65535,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.954295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xf13037b1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=62) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.960614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf13037b3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=30) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.963402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf13037b5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=31) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:18.963877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.utils [-] Std library socket module is patched by eventlet. Requesting std library socket module from eventlet. {{(pid=105573) __init__ /opt/stack/neutron/neutron/agent/common/utils.py:91}} Oct 23 00:47:18.969595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Mapping physical network physnet1 to bridge br-data Oct 23 00:47:18.971898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Bridge br-data datapath-id = 0x00001ef76765c848 Oct 23 00:47:18.972606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-data, may_exist=True, datapath_type=system) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:18.976019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-data, column=protocols, values=('OpenFlow14', 'OpenFlow13', 'OpenFlow10')) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:18.976686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:18.994005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-data, mode=secure) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:19.014353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'disable-in-band': 'true'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:19.031480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-data. {{(pid=105573) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:103}} Oct 23 00:47:19.032304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-data, targets=['tcp:127.0.0.1:6633']) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.050207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=bb05b514-b4fd-4931-a0f7-c19308186a67, col_values=(('inactivity_probe', 10000),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.057330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-data has datapath-ID 00001ef76765c848 Oct 23 00:47:20.059725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x1321191b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:20.060673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-int, port=int-br-data, may_exist=True) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.061420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=int-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.090123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=int-br-data, col_values=(('other_config', {'mcast-snooping-flood-reports': 'False', 'mcast-snooping-flood': 'False'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.095069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-data, port=phy-br-data, may_exist=True) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.096063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.111190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf13037b7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:20.122441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1321191d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:20.123956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=int-br-data, col_values=(('options', {'peer': 'phy-br-data'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.129782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('options', {'peer': 'int-br-data'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:20.139747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Port {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:20.144776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroup {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:20.152161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroupRule {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:20.153234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Network {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:20.162859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Subnet {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:20.163975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for AddressGroup {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:20.388963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:20.389295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:20.389477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:20.389663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:20.389907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:20.390141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:20.456181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Init firewall settings (driver=openvswitch) {{(pid=105573) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:121}} Oct 23 00:47:20.457481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow12', 'OpenFlow11')) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:21.471541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2818,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:21.474605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee281a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:21.477031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee281c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:21.479477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee281e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:21.481820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2820,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:21.482819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.ip_conntrack [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Starting ip_conntrack _process_queue_worker() threads {{(pid=105573) _start_process_queue /opt/stack/neutron/neutron/agent/linux/ip_conntrack.py:80}} Oct 23 00:47:21.483430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:21.484850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpbqao4fzz/privsep.sock'] Oct 23 00:47:21.498685 dv-cinder-master-3-iscsi sudo[107263]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpbqao4fzz/privsep.sock Oct 23 00:47:21.500206 dv-cinder-master-3-iscsi sudo[107263]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 23 00:47:22.838955 dv-cinder-master-3-iscsi sudo[107263]: pam_unix(sudo:session): session closed for user root Oct 23 00:47:22.841219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Spawned new privsep daemon via rootwrap Oct 23 00:47:22.841737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Accepted privsep connection to /tmp/tmpbqao4fzz/privsep.sock {{(pid=105573) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Oct 23 00:47:22.842914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep daemon starting Oct 23 00:47:22.843163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Oct 23 00:47:22.843405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none Oct 23 00:47:22.843637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 107272 Oct 23 00:47:22.846418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bfccbe-1546-4cdb-9cc2-4db422a2b30a]: (2,) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.473747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=107272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 00:47:23.474707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=107272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 00:47:23.475757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=107272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 00:47:23.706532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbce1fc-db48-40a4-9cc7-74c46854cf3e]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.707214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.716768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43f7b6-2730-40a5-a5ff-9ae1942867b5]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.717448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.726460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a194ae9-14a8-4345-baa3-ed4d334ff2fe]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.727083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.735971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[c956c336-581c-4dc5-bbc7-5a90a86988b4]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.736636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.745802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdeac9-d4bd-4725-b822-5372ba937753]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.746406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.755320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc25bf-2f0a-40e9-aa84-22a0c7b79c34]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.756051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.766581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abd4fb3-c625-418b-bcf1-1ebee32b50ca]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.767139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.775817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71bb630-d08e-4ecf-8f5d-93ea210b433c]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.776374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.785300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[0112b26b-d6e6-45cc-b5a8-9244f67c5416]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.785826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Processing 1 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:23.794894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aa3342-916f-466d-8aa5-0267abd6da4f]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:23.795497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > agent ovs_restarted 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:23.796020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > SecurityGroupRule after_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:23.796369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > SecurityGroupRule after_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:23.796695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > Port after_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:23.797035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > Port after_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:23.797346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > AddressGroup after_update 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:23.797705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > AddressGroup after_delete 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:24.014293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.driver.init_handler-8789976273556'] for Open vSwitch agent (None), after_init {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:24.015020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Subscribe: > ovsdb after_read 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:24.015702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Subscribe: > Trunk before_create 55550000 {{(pid=105573) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 23 00:47:24.016045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Registering callback for Trunk {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:24.016344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Registering callback for SubPort {{(pid=105573) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 23 00:47:24.060206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Unregistering callback for Trunk {{(pid=105573) unregister /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:72}} Oct 23 00:47:24.060523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent initialized successfully, now running... Oct 23 00:47:24.061657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.ovs_vsctl_cmd', '--privsep_sock_path', '/tmp/tmpg7yxjy2s/privsep.sock'] Oct 23 00:47:24.074560 dv-cinder-master-3-iscsi sudo[107322]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmpg7yxjy2s/privsep.sock Oct 23 00:47:24.075338 dv-cinder-master-3-iscsi sudo[107322]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 23 00:47:25.292036 dv-cinder-master-3-iscsi sudo[107322]: pam_unix(sudo:session): session closed for user root Oct 23 00:47:25.299485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Spawned new privsep daemon via rootwrap Oct 23 00:47:25.300048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Accepted privsep connection to /tmp/tmpg7yxjy2s/privsep.sock {{(pid=105573) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Oct 23 00:47:25.301262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep daemon starting Oct 23 00:47:25.301480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Oct 23 00:47:25.301747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none Oct 23 00:47:25.301983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 107329 Oct 23 00:47:25.304880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56b0d89-e4cf-4378-956f-891f287be5b4]: (2,) {{(pid=107329) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:25.523730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 {{(pid=107329) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 23 00:47:25.530123 dv-cinder-master-3-iscsi ovs-vsctl[107334]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=10 --id=@manager -- create Manager "target=\"ptcp:6640:127.0.0.1\"" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 Oct 23 00:47:25.532981 dv-cinder-master-3-iscsi ovs-vsctl[107334]: ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1" Oct 23 00:47:25.534681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo_concurrency.processutils [-] CMD "ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000" returned: 1 in 0.011s {{(pid=107329) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 23 00:47:25.535097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77936d3-69d2-4c46-a5ec-ff900f1e2585]: (4, ('', 'ovs-vsctl: multiple rows in Manager match "ptcp:6640:127.0.0.1"\n')) {{(pid=107329) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:25.535899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Launching async process [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]. {{(pid=105573) start /opt/stack/neutron/neutron/agent/common/async_process.py:117}} Oct 23 00:47:25.536364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Running command: ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] {{(pid=105573) create_process /opt/stack/neutron/neutron/agent/linux/utils.py:84}} Oct 23 00:47:25.544102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:25.545056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:0 started Oct 23 00:47:25.550711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["18549442-be5b-400c-9487-c4c39ab70a8d","initial","int-br-data",1,["map",[]]],["c2aba69a-68f1-4b66-9d96-1fec0cbe195e","initial","br-data",65534,["map",[]]],["34657230-0c45-49e2-945f-08fcab19944d","initial","phy-br-data",2,["map",[]]],["d9a06c82-c31e-498b-a4b1-c401018daca4","initial","br-int",65534,["map",[]]],["77b7cc53-d052-4bd4-aeb8-92778462902a","initial","eth1",1,["map",[]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:47:25.554276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2822,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=623000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.554381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:25.554915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:0 - starting polling. Elapsed:0.010 Oct 23 00:47:25.556344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:25.557325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:0 - port information retrieved. Elapsed:0.013 Oct 23 00:47:25.557619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Cleaning stale br-int flows Oct 23 00:47:25.557939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reserved cookies for br-int: {3728779868001237721} Oct 23 00:47:25.561792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2824,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=614000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'vlan_vid': 8191}),packet_count=0,priority=65535,table_id=0), OFPFlowStats(byte_count=673,cookie=3728779868001237721,duration_nsec=454000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 1}),packet_count=3,priority=2,table_id=0), OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=628000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=0)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.563685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2826,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.565617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2828,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.567718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee282a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=639000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.569877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee282c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=24,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=629000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=24)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.572016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee282e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=25,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.574355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2830,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=61,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.576453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2832,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=30,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=618000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=30)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.579192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2834,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=31,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=615000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=31)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.581352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2836,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=59,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=646000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=59)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.584619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2838,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=60,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=645000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=60)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.587058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee283a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=62,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=635000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=62)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.590024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee283c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=834000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionCTClear(experimenter=8992,len=16,subtype=43,type=65535), NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=71,type=65535)],len=40,type=4)],length=104,match=OFPMatch(oxm_fields={'ct_state': (32, 32)}),packet_count=0,priority=110,table_id=71), OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=883000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=71)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.592057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee283e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=876000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=72)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.594291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2840,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=868000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=73)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.596119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2842,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=77,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.598224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2844,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=78,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.600701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2846,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=864000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=81)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.603203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2848,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=857000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=82)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.606176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee284a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=91,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=829000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=94,type=65535)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=1,table_id=91)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.609660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee284c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=92,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=823000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=92)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.611814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee284e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=93,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=817000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=93)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.612196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Cleaning stale br-data flows Oct 23 00:47:25.612550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reserved cookies for br-data: {17615684023133517336} Oct 23 00:47:25.615220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x1321191f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17615684023133517336,duration_nsec=501000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 2}),packet_count=0,priority=2,table_id=0), OFPFlowStats(byte_count=673,cookie=17615684023133517336,duration_nsec=555000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=3,priority=0,table_id=0)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.617325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x13211921,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.619357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x13211923,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.621192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x13211925,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=3,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:25.621509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:0 - cleanup stale flows. Elapsed:0.077 Oct 23 00:47:25.621864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:0 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.077 Oct 23 00:47:27.545701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:1 started Oct 23 00:47:27.548354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2850,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=619000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:27.548963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:27.549322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:1 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:29.546950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:2 started Oct 23 00:47:29.549594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2852,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=620000000,duration_sec=10,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:29.550149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:29.550535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:2 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:30.049237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING oslo_policy.policy [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Oct 23 00:47:30.049777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING oslo_policy.policy [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Oct 23 00:47:30.053983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:47:29Z,description='Default security group',id=fb4cad58-9d1a-406e-8c60-42280f08dbaa,is_default=True,name='default',project_id='5d9d6de2fc3445e68e41a0a8d387b372',revision_number=1,rules=[SecurityGroupRule(0e18736d-5ef7-4cb9-994b-eda552bc8ea9),SecurityGroupRule(1025bf1e-3f6d-4058-8a54-331c0ee8caa1),SecurityGroupRule(2c115875-1ca8-4208-8b90-fb6890c6061b),SecurityGroupRule(3c485faf-9b26-44db-b35d-c23d3699774b)],shared=False,stateful=True,updated_at=2022-10-23T00:47:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:30.054514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (fb4cad58-9d1a-406e-8c60-42280f08dbaa), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:30.055369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:29Z,description=,direction='egress',ethertype='IPv4',id=0e18736d-5ef7-4cb9-994b-eda552bc8ea9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d9d6de2fc3445e68e41a0a8d387b372',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb4cad58-9d1a-406e-8c60-42280f08dbaa,updated_at=2022-10-23T00:47:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:30.055724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0e18736d-5ef7-4cb9-994b-eda552bc8ea9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:30.056077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Security group rule updated ['fb4cad58-9d1a-406e-8c60-42280f08dbaa'] Oct 23 00:47:30.057022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:29Z,description=,direction='ingress',ethertype='IPv4',id=1025bf1e-3f6d-4058-8a54-331c0ee8caa1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d9d6de2fc3445e68e41a0a8d387b372',protocol=,remote_address_group_id=,remote_group_id=fb4cad58-9d1a-406e-8c60-42280f08dbaa,remote_ip_prefix=,revision_number=0,security_group_id=fb4cad58-9d1a-406e-8c60-42280f08dbaa,updated_at=2022-10-23T00:47:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:30.057370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1025bf1e-3f6d-4058-8a54-331c0ee8caa1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:30.057692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Security group rule updated ['fb4cad58-9d1a-406e-8c60-42280f08dbaa'] Oct 23 00:47:30.058345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:29Z,description=,direction='egress',ethertype='IPv6',id=2c115875-1ca8-4208-8b90-fb6890c6061b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d9d6de2fc3445e68e41a0a8d387b372',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb4cad58-9d1a-406e-8c60-42280f08dbaa,updated_at=2022-10-23T00:47:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:30.058690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2c115875-1ca8-4208-8b90-fb6890c6061b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:30.059051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Security group rule updated ['fb4cad58-9d1a-406e-8c60-42280f08dbaa'] Oct 23 00:47:30.059685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:29Z,description=,direction='ingress',ethertype='IPv6',id=3c485faf-9b26-44db-b35d-c23d3699774b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d9d6de2fc3445e68e41a0a8d387b372',protocol=,remote_address_group_id=,remote_group_id=fb4cad58-9d1a-406e-8c60-42280f08dbaa,remote_ip_prefix=,revision_number=0,security_group_id=fb4cad58-9d1a-406e-8c60-42280f08dbaa,updated_at=2022-10-23T00:47:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:30.060045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3c485faf-9b26-44db-b35d-c23d3699774b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:30.060354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Security group rule updated ['fb4cad58-9d1a-406e-8c60-42280f08dbaa'] Oct 23 00:47:30.206498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:47:29Z,description='',dns_domain=None,id=e5bb4341-0594-481a-a0b9-0e978f575bdb,mtu=1500,name='private',project_id='5d9d6de2fc3445e68e41a0a8d387b372',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(e5bb4341-0594-481a-a0b9-0e978f575bdb),segments=[NetworkSegment(cca8dbf9-6824-4bd3-8c38-210e29a51a9f)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:47:29Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:30.206856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (e5bb4341-0594-481a-a0b9-0e978f575bdb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-4950da8f-9396-4468-9354-17ae615b27d7 demo demo] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network e5bb4341-0594-481a-a0b9-0e978f575bdb with segmentation id not found. Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:47:30.347886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:47:30.348867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:47:30.348867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:47:30.348867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:47:30.348867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network e5bb4341-0594-481a-a0b9-0e978f575bdb with segmentation id not found. Oct 23 00:47:30.348867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:47:31.547777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:3 started Oct 23 00:47:31.550572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2854,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=621000000,duration_sec=12,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:31.551139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:31.551517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:3 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:33.549260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:4 started Oct 23 00:47:33.551990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2856,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=623000000,duration_sec=14,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:33.552572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:33.552955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:4 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:33.735084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fbc6f551-1728-41b4-b973-b15a7893b433 demo admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ddb7c9aa-38a6-4012-b8b8-abd10576ed5a)],cidr=172.20.0.0/26,created_at=2022-10-23T00:47:33Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=a0952b7c-4e64-412e-af50-2047b7a58d06,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='private-subnet',network_id=e5bb4341-0594-481a-a0b9-0e978f575bdb,project_id='5d9d6de2fc3445e68e41a0a8d387b372',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id='4a83af05-74eb-4eb4-b507-e41b63b8c650',updated_at=2022-10-23T00:47:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:33.735544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fbc6f551-1728-41b4-b973-b15a7893b433 demo admin] Publish callbacks [] for Subnet (a0952b7c-4e64-412e-af50-2047b7a58d06), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:34.733849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9beb5416-8793-4f7a-9b17-70b270565f85 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:47:34Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e5bb4341-0594-481a-a0b9-0e978f575bdb',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=36027a75-3b26-4728-a464-23e4dbba5d4a,mac_address=fa:16:3e:50:8f:70,name='',network_id=e5bb4341-0594-481a-a0b9-0e978f575bdb,numa_affinity_policy=,project_id='5d9d6de2fc3445e68e41a0a8d387b372',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(36027a75-3b26-4728-a464-23e4dbba5d4a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:47:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:34.734490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9beb5416-8793-4f7a-9b17-70b270565f85 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (36027a75-3b26-4728-a464-23e4dbba5d4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:35.006552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9beb5416-8793-4f7a-9b17-70b270565f85 None None] Resource Port 36027a75-3b26-4728-a464-23e4dbba5d4a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=36027a75-3b26-4728-a464-23e4dbba5d4a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=36027a75-3b26-4728-a464-23e4dbba5d4a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=36027a75-3b26-4728-a464-23e4dbba5d4a,segment=NetworkSegment(cca8dbf9-6824-4bd3-8c38-210e29a51a9f),segment_id=cca8dbf9-6824-4bd3-8c38-210e29a51a9f)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:47:35.007015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9beb5416-8793-4f7a-9b17-70b270565f85 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (36027a75-3b26-4728-a464-23e4dbba5d4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:35.550138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:5 started Oct 23 00:47:35.552767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2858,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=624000000,duration_sec=16,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:35.553358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:35.553694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:5 - starting polling. Elapsed:0.004 Oct 23 00:47:35.554686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:35.555683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:5 - port information retrieved. Elapsed:0.006 Oct 23 00:47:35.556007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:5 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:47:37.550795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:6 started Oct 23 00:47:37.553441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee285a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=624000000,duration_sec=18,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:37.554012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:37.554422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:6 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:39.551661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:7 started Oct 23 00:47:39.554288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee285c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=625000000,duration_sec=20,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:39.554995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:39.555507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:7 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:41.553003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:8 started Oct 23 00:47:41.556117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee285e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=627000000,duration_sec=22,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:41.556675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:41.557047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:8 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:41.691725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["eb2a003a-45ec-499e-b491-460d9b37253c","insert","tap36027a75-3b",["set",[]],["map",[["attached-mac","fa:16:3e:50:8f:70"],["iface-id","36027a75-3b26-4728-a464-23e4dbba5d4a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:47:41.699778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["eb2a003a-45ec-499e-b491-460d9b37253c","old",null,["set",[]],null],["","new","tap36027a75-3b",2,["map",[["attached-mac","fa:16:3e:50:8f:70"],["iface-id","36027a75-3b26-4728-a464-23e4dbba5d4a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:47:43.360679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-41138b26-f4f1-4ad2-b701-2c70374c3f12 None None] Resource Port 36027a75-3b26-4728-a464-23e4dbba5d4a updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:47:43.361322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-41138b26-f4f1-4ad2-b701-2c70374c3f12 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (36027a75-3b26-4728-a464-23e4dbba5d4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:43.553972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:9 started Oct 23 00:47:43.556905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2860,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=628000000,duration_sec=24,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:43.557645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:43.558223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:9 - starting polling. Elapsed:0.005 Oct 23 00:47:43.559311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:43.560267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:9 - port information retrieved. Elapsed:0.007 Oct 23 00:47:43.560670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': {'36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'removed': set(), 'updated': {'36027a75-3b26-4728-a464-23e4dbba5d4a'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:47:43.561408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '36027a75-3b26-4728-a464-23e4dbba5d4a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e5bb4341-0594-481a-a0b9-0e978f575bdb', 'network_id': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'port_id': '36027a75-3b26-4728-a464-23e4dbba5d4a', 'mac_address': 'fa:16:3e:50:8f:70', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a0952b7c-4e64-412e-af50-2047b7a58d06', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:47:43.562338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 36027a75-3b26-4728-a464-23e4dbba5d4a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:47:43.562741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 36027a75-3b26-4728-a464-23e4dbba5d4a updated. Details: {'device': '36027a75-3b26-4728-a464-23e4dbba5d4a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e5bb4341-0594-481a-a0b9-0e978f575bdb', 'network_id': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'port_id': '36027a75-3b26-4728-a464-23e4dbba5d4a', 'mac_address': 'fa:16:3e:50:8f:70', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a0952b7c-4e64-412e-af50-2047b7a58d06', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:47:43.563172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 1 as local vlan for net-id=e5bb4341-0594-481a-a0b9-0e978f575bdb, seg-id=392 Oct 23 00:47:43.566342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211927,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4488), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4097}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:43.568923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2862,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4097)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4488}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:43.571019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap36027a75-3b, col_values=(('tag', 1),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:43.571543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap36027a75-3b, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:43.572017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap36027a75-3b, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:43.576513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap36027a75-3b, col_values=(('other_config', {'net_uuid': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '392'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:47:43.584068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2864,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:43.584436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:9 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.023 Oct 23 00:47:43.584841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:47:43.585669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'36027a75-3b26-4728-a464-23e4dbba5d4a'} Oct 23 00:47:43.591351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:47:43.591645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:47:43.593565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:47:43.632002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1ac7a-fa7b-4225-b20b-050f00c0871e]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:47:43.633992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:9 - agent port security group processed in 0.073 Oct 23 00:47:43.634576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 36027a75-3b26-4728-a464-23e4dbba5d4a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:47:43.773110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['36027a75-3b26-4728-a464-23e4dbba5d4a'] and devices down [] completed. Oct 23 00:47:43.774036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:9 - ports processed. Elapsed:0.220 Oct 23 00:47:43.774377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:9 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.221 Oct 23 00:47:45.554845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:10 started Oct 23 00:47:45.557565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2866,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=628000000,duration_sec=26,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:45.558147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:45.558507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:10 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:47.555550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:11 started Oct 23 00:47:47.558199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2868,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=629000000,duration_sec=28,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:47.558806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:47.559165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:11 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:49.556855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:12 started Oct 23 00:47:49.559646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee286a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=630000000,duration_sec=30,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:49.560216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:49.560564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:12 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:49.819959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:47:49Z,description='Default security group',id=582ccf13-fb23-4b22-ab32-47b853cf939f,is_default=True,name='default',project_id='2d2a10b90d4949fc9a5b267280f9f9c5',revision_number=1,rules=[SecurityGroupRule(69094357-1887-44b3-8759-859da15b04b7),SecurityGroupRule(a31bd1e3-c092-4e1a-9b04-3160fab6f923),SecurityGroupRule(bda5149a-5498-4f17-8c38-d007908c6ab5),SecurityGroupRule(e26a7b9c-34bb-4c57-a6e5-7f52355fae4e)],shared=False,stateful=True,updated_at=2022-10-23T00:47:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:49.820558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (582ccf13-fb23-4b22-ab32-47b853cf939f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:49.821330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:49Z,description=,direction='egress',ethertype='IPv4',id=69094357-1887-44b3-8759-859da15b04b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d2a10b90d4949fc9a5b267280f9f9c5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=582ccf13-fb23-4b22-ab32-47b853cf939f,updated_at=2022-10-23T00:47:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:49.821724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (69094357-1887-44b3-8759-859da15b04b7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:49.822065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Security group rule updated ['582ccf13-fb23-4b22-ab32-47b853cf939f'] Oct 23 00:47:49.822818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:49Z,description=,direction='ingress',ethertype='IPv6',id=a31bd1e3-c092-4e1a-9b04-3160fab6f923,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d2a10b90d4949fc9a5b267280f9f9c5',protocol=,remote_address_group_id=,remote_group_id=582ccf13-fb23-4b22-ab32-47b853cf939f,remote_ip_prefix=,revision_number=0,security_group_id=582ccf13-fb23-4b22-ab32-47b853cf939f,updated_at=2022-10-23T00:47:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:49.823176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a31bd1e3-c092-4e1a-9b04-3160fab6f923), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:49.823504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Security group rule updated ['582ccf13-fb23-4b22-ab32-47b853cf939f'] Oct 23 00:47:49.824156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:49Z,description=,direction='ingress',ethertype='IPv4',id=bda5149a-5498-4f17-8c38-d007908c6ab5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d2a10b90d4949fc9a5b267280f9f9c5',protocol=,remote_address_group_id=,remote_group_id=582ccf13-fb23-4b22-ab32-47b853cf939f,remote_ip_prefix=,revision_number=0,security_group_id=582ccf13-fb23-4b22-ab32-47b853cf939f,updated_at=2022-10-23T00:47:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:49.824509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (bda5149a-5498-4f17-8c38-d007908c6ab5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:49.824864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Security group rule updated ['582ccf13-fb23-4b22-ab32-47b853cf939f'] Oct 23 00:47:49.825508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:47:49Z,description=,direction='egress',ethertype='IPv6',id=e26a7b9c-34bb-4c57-a6e5-7f52355fae4e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d2a10b90d4949fc9a5b267280f9f9c5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=582ccf13-fb23-4b22-ab32-47b853cf939f,updated_at=2022-10-23T00:47:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:49.825859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e26a7b9c-34bb-4c57-a6e5-7f52355fae4e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:49.826191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Security group rule updated ['582ccf13-fb23-4b22-ab32-47b853cf939f'] Oct 23 00:47:50.007348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:47:49Z,description='',dns_domain=None,id=f9ff398c-cd2a-4430-b908-7f7163c266f3,mtu=1500,name='public',project_id='2d2a10b90d4949fc9a5b267280f9f9c5',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(f9ff398c-cd2a-4430-b908-7f7163c266f3),segments=[NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:47:49Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:50.007979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bd9cd24-dd28-44d6-9bf6-903e5576c70c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (f9ff398c-cd2a-4430-b908-7f7163c266f3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:51.558456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:13 started Oct 23 00:47:51.561143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee286c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=632000000,duration_sec=32,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:51.561738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:51.562072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:13 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:53.559580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:14 started Oct 23 00:47:53.562450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee286e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=633000000,duration_sec=34,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:53.563055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:53.563843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:14 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:47:54.202104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-20ad6dc1-f048-4c80-a314-9255bd5e20b6 demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:47:53Z,data_plane_status=None,description='',device_id='09caefe4-a93a-4ce9-ac0e-c6b10e41b56f',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8edb9f18-7960-4eae-89c3-6b941ce63ba3,mac_address=fa:16:3e:47:7b:9f,name='',network_id=e5bb4341-0594-481a-a0b9-0e978f575bdb,numa_affinity_policy=,project_id='5d9d6de2fc3445e68e41a0a8d387b372',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8edb9f18-7960-4eae-89c3-6b941ce63ba3),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:47:53Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:54.202565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-20ad6dc1-f048-4c80-a314-9255bd5e20b6 demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8edb9f18-7960-4eae-89c3-6b941ce63ba3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:54.670481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-20ad6dc1-f048-4c80-a314-9255bd5e20b6 demo admin] Received resource Port update without any changes: 8edb9f18-7960-4eae-89c3-6b941ce63ba3 {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:47:55.561121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:15 started Oct 23 00:47:55.563743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2870,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=634000000,duration_sec=36,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:55.564345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:55.564683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:15 - starting polling. Elapsed:0.004 Oct 23 00:47:55.565723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:55.566593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:15 - port information retrieved. Elapsed:0.006 Oct 23 00:47:55.566923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:15 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:47:56.424980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f090917e-4e02-49ea-957b-1b21422c2250 None None] Resource Port 8edb9f18-7960-4eae-89c3-6b941ce63ba3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=8edb9f18-7960-4eae-89c3-6b941ce63ba3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8edb9f18-7960-4eae-89c3-6b941ce63ba3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:47:56.426034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f090917e-4e02-49ea-957b-1b21422c2250 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8edb9f18-7960-4eae-89c3-6b941ce63ba3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:56.668817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f090917e-4e02-49ea-957b-1b21422c2250 None None] Resource Port 8edb9f18-7960-4eae-89c3-6b941ce63ba3 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8edb9f18-7960-4eae-89c3-6b941ce63ba3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8edb9f18-7960-4eae-89c3-6b941ce63ba3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8edb9f18-7960-4eae-89c3-6b941ce63ba3,segment=NetworkSegment(cca8dbf9-6824-4bd3-8c38-210e29a51a9f),segment_id=cca8dbf9-6824-4bd3-8c38-210e29a51a9f)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:47:56.669472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f090917e-4e02-49ea-957b-1b21422c2250 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8edb9f18-7960-4eae-89c3-6b941ce63ba3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:57.562376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:16 started Oct 23 00:47:57.565144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2872,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=636000000,duration_sec=38,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:57.565716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:57.566054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:16 - starting polling. Elapsed:0.004 Oct 23 00:47:57.567042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:57.567912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:16 - port information retrieved. Elapsed:0.006 Oct 23 00:47:57.568238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:16 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:47:58.473333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2e504ec6-0f09-47b4-a83e-5e48f047ce33 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(a0654455-e39f-4e3b-a1bb-a69ba9a4b37c)],cidr=172.37.4.0/24,created_at=2022-10-23T00:47:58Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.37.4.1,host_routes=[],id=dd152ba8-6213-403c-b7fc-9b4ab174f9a2,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='public-subnet',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,project_id='2d2a10b90d4949fc9a5b267280f9f9c5',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:47:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:47:58.473715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2e504ec6-0f09-47b4-a83e-5e48f047ce33 admin admin] Publish callbacks [] for Subnet (dd152ba8-6213-403c-b7fc-9b4ab174f9a2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:47:59.562891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:17 started Oct 23 00:47:59.565624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2874,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=636000000,duration_sec=40,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:47:59.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:47:59.567099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:17 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:01.563829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:18 started Oct 23 00:48:01.566329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2876,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=637000000,duration_sec=42,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:01.566919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:01.567352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:18 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:01.681287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0686f6de-8df7-4aec-baac-c1d8a5c20fa9","insert","qr-8edb9f18-79",["set",[]],["map",[["attached-mac","fa:16:3e:47:7b:9f"],["iface-id","8edb9f18-7960-4eae-89c3-6b941ce63ba3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:48:01.682102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0686f6de-8df7-4aec-baac-c1d8a5c20fa9","old",null,["set",[]],null],["","new","qr-8edb9f18-79",3,["map",[["attached-mac","fa:16:3e:47:7b:9f"],["iface-id","8edb9f18-7960-4eae-89c3-6b941ce63ba3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:48:02.766488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9c5961a2-fb9c-4941-a517-e4f26e56f4db demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:48:02Z,data_plane_status=None,description='',device_id='09caefe4-a93a-4ce9-ac0e-c6b10e41b56f',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,mac_address=fa:16:3e:d6:b6:4c,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0db4d4c4-d261-4750-963a-1eb2bdb77e41),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:48:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:48:02.767201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9c5961a2-fb9c-4941-a517-e4f26e56f4db demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0db4d4c4-d261-4750-963a-1eb2bdb77e41), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:03.565491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:19 started Oct 23 00:48:03.568835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2878,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=640000000,duration_sec=44,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:03.569442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:03.570035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:19 - starting polling. Elapsed:0.005 Oct 23 00:48:03.571189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:03.572222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:19 - port information retrieved. Elapsed:0.007 Oct 23 00:48:03.572544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'36027a75-3b26-4728-a464-23e4dbba5d4a', '8edb9f18-7960-4eae-89c3-6b941ce63ba3'}, 'added': {'8edb9f18-7960-4eae-89c3-6b941ce63ba3'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:48:03.573290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'port_id': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'mac_address': 'fa:16:3e:47:7b:9f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a0952b7c-4e64-412e-af50-2047b7a58d06', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:48:03.574252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 8edb9f18-7960-4eae-89c3-6b941ce63ba3 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:48:03.574573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 8edb9f18-7960-4eae-89c3-6b941ce63ba3 updated. Details: {'device': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'port_id': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'mac_address': 'fa:16:3e:47:7b:9f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a0952b7c-4e64-412e-af50-2047b7a58d06', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 23 00:48:03.575559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-8edb9f18-79, col_values=(('tag', 1),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:03.576170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-8edb9f18-79, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:03.576604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-8edb9f18-79, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:03.585706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-8edb9f18-79, col_values=(('other_config', {'net_uuid': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '392'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:03.596520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee287a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:03.596950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:19 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.024 Oct 23 00:48:03.597250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:48:03.597537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'8edb9f18-7960-4eae-89c3-6b941ce63ba3'} Oct 23 00:48:03.598742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:48:03.599026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:48:03.600916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:48:03.638601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd460e1c-e1a8-4fab-844d-b8c6cc8b4acd]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:48:03.639547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:19 - agent port security group processed in 0.067 Oct 23 00:48:03.641083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 8edb9f18-7960-4eae-89c3-6b941ce63ba3 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:48:04.263203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['8edb9f18-7960-4eae-89c3-6b941ce63ba3'] and devices down [] completed. Oct 23 00:48:04.264276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:19 - ports processed. Elapsed:0.698 Oct 23 00:48:04.264768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:19 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.700 Oct 23 00:48:04.469751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 8edb9f18-7960-4eae-89c3-6b941ce63ba3 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:48:04.470456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8edb9f18-7960-4eae-89c3-6b941ce63ba3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:04.857832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a623649a-e462-4132-a837-f68fe6cd2f03 None None] Resource Port 0db4d4c4-d261-4750-963a-1eb2bdb77e41 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:48:04.858251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a623649a-e462-4132-a837-f68fe6cd2f03 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0db4d4c4-d261-4750-963a-1eb2bdb77e41), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:05.025498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a623649a-e462-4132-a837-f68fe6cd2f03 None None] Resource Port 0db4d4c4-d261-4750-963a-1eb2bdb77e41 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:48:05.025915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a623649a-e462-4132-a837-f68fe6cd2f03 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0db4d4c4-d261-4750-963a-1eb2bdb77e41), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:05.362297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cadf41de-08a1-4a9e-8a50-b9c0c840b248","insert","qg-0db4d4c4-d2",["set",[]],["map",[["attached-mac","fa:16:3e:d6:b6:4c"],["iface-id","0db4d4c4-d261-4750-963a-1eb2bdb77e41"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:48:05.390849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cadf41de-08a1-4a9e-8a50-b9c0c840b248","old",null,["set",[]],null],["","new","qg-0db4d4c4-d2",4,["map",[["attached-mac","fa:16:3e:d6:b6:4c"],["iface-id","0db4d4c4-d261-4750-963a-1eb2bdb77e41"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:48:05.566481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:20 started Oct 23 00:48:05.569217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee287c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=640000000,duration_sec=46,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:05.570001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:05.571032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:20 - starting polling. Elapsed:0.004 Oct 23 00:48:05.572371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:05.573588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:20 - port information retrieved. Elapsed:0.007 Oct 23 00:48:05.573902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'36027a75-3b26-4728-a464-23e4dbba5d4a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3'}, 'added': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41'}, 'removed': set(), 'updated': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:48:05.574501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'mac_address': 'fa:16:3e:d6:b6:4c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.91'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:48:05.574936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'port_id': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'mac_address': 'fa:16:3e:47:7b:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a0952b7c-4e64-412e-af50-2047b7a58d06', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:48:05.576087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 0db4d4c4-d261-4750-963a-1eb2bdb77e41 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:48:05.576406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0db4d4c4-d261-4750-963a-1eb2bdb77e41 updated. Details: {'device': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'mac_address': 'fa:16:3e:d6:b6:4c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.91'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:48:05.576754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 2 as local vlan for net-id=f9ff398c-cd2a-4430-b908-7f7163c266f3, seg-id=None Oct 23 00:48:05.579781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x13211929,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPopVlan(len=8,type=18), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=32,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4098}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:05.582272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x5fee287e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPushVlan(ethertype=33024,len=8,type=17), OFPActionSetField(vlan_vid=4098)],len=32,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 0}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:05.583316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0db4d4c4-d2, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.583767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0db4d4c4-d2, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.587324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0db4d4c4-d2, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.592690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0db4d4c4-d2, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.602369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2880,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:05.602794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 8edb9f18-7960-4eae-89c3-6b941ce63ba3 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:48:05.603200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 8edb9f18-7960-4eae-89c3-6b941ce63ba3 updated. Details: {'device': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'port_id': '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'mac_address': 'fa:16:3e:47:7b:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a0952b7c-4e64-412e-af50-2047b7a58d06', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 23 00:48:05.604261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-8edb9f18-79, col_values=(('tag', 1),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.604756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-8edb9f18-79, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.605252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-8edb9f18-79, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.605806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:48:05.606619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-8edb9f18-79, col_values=(('other_config', {'net_uuid': 'e5bb4341-0594-481a-a0b9-0e978f575bdb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '392', 'tag': '1'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:05.607359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:48:05.609807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2882,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:05.610228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:20 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.036 Oct 23 00:48:05.610673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:48:05.611047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'0db4d4c4-d261-4750-963a-1eb2bdb77e41'} Oct 23 00:48:05.612277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:48:05.612631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:48:05.614649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:48:05.654609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[428074b7-c37c-4b00-9977-360c1390976c]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:48:05.655330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:48:05.655668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:48:05.656911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:48:05.657463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:48:05.659579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:48:05.703153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be19bf4-b5ed-4f22-91c3-d9403698bbc6]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:48:05.703805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:20 - agent port security group processed in 0.130 Oct 23 00:48:05.704472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 0db4d4c4-d261-4750-963a-1eb2bdb77e41 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:48:05.704820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 8edb9f18-7960-4eae-89c3-6b941ce63ba3 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:48:05.964450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 0db4d4c4-d261-4750-963a-1eb2bdb77e41 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0db4d4c4-d261-4750-963a-1eb2bdb77e41,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:48:05.964887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0db4d4c4-d261-4750-963a-1eb2bdb77e41), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:06.050779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3'] and devices down [] completed. Oct 23 00:48:06.051173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:20 - ports processed. Elapsed:0.485 Oct 23 00:48:06.051607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:20 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.485 Oct 23 00:48:07.567513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:21 started Oct 23 00:48:07.570536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2884,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=641000000,duration_sec=48,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:07.571031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:07.571368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:21 - starting polling. Elapsed:0.004 Oct 23 00:48:07.572567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:48:07.573773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:21 - port information retrieved. Elapsed:0.007 Oct 23 00:48:07.574094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'36027a75-3b26-4728-a464-23e4dbba5d4a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3'}, 'added': set(), 'removed': set(), 'updated': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:48:07.574869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'mac_address': 'fa:16:3e:d6:b6:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.91'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:48:07.575780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 0db4d4c4-d261-4750-963a-1eb2bdb77e41 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:48:07.576091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0db4d4c4-d261-4750-963a-1eb2bdb77e41 updated. Details: {'device': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'device_id': '09caefe4-a93a-4ce9-ac0e-c6b10e41b56f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'mac_address': 'fa:16:3e:d6:b6:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.91'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:48:07.577146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0db4d4c4-d2, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:07.577532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0db4d4c4-d2, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:07.577950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0db4d4c4-d2, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:07.578390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:48:07.579138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0db4d4c4-d2, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:48:07.579767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:48:07.584682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2886,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:07.585089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:21 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.011 Oct 23 00:48:07.585442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:48:07.585994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:48:07.587157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:48:07.587437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:48:07.589372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:48:07.626201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6423c03-ae4c-437c-923b-e5d1b6548e76]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:48:07.626841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:21 - agent port security group processed in 0.052 Oct 23 00:48:07.627443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 0db4d4c4-d261-4750-963a-1eb2bdb77e41 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:48:07.759570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['0db4d4c4-d261-4750-963a-1eb2bdb77e41'] and devices down [] completed. Oct 23 00:48:07.760293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:21 - ports processed. Elapsed:0.193 Oct 23 00:48:07.760681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:21 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.193 Oct 23 00:48:09.569064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:22 started Oct 23 00:48:09.571763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2888,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=642000000,duration_sec=50,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:09.572652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:09.573033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:22 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:11.571604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:23 started Oct 23 00:48:11.574988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee288a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=646000000,duration_sec=52,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:11.575989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:11.576610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:23 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:13.575955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:24 started Oct 23 00:48:13.584822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee288c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=654000000,duration_sec=54,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:13.585949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:13.586802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:24 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:48:15.576983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:25 started Oct 23 00:48:15.581562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee288e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=652000000,duration_sec=56,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:15.582503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:15.583080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:25 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:48:17.577582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:26 started Oct 23 00:48:17.580456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2890,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=651000000,duration_sec=58,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:17.581087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:17.581606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:26 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:19.578278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:27 started Oct 23 00:48:19.580962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2892,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=652000000,duration_sec=60,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:19.581527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:19.581877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:27 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:21.579530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:28 started Oct 23 00:48:21.582890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2894,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=653000000,duration_sec=62,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:21.583794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:21.584398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:28 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:23.581075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:29 started Oct 23 00:48:23.586186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2896,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=655000000,duration_sec=64,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:23.587124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:23.587621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:29 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:48:25.582410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:30 started Oct 23 00:48:25.585198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2898,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=656000000,duration_sec=66,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:25.585984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:25.587180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:30 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:27.583765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:31 started Oct 23 00:48:27.588558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee289a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=658000000,duration_sec=68,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:27.589494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:27.590058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:31 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:48:29.584899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:32 started Oct 23 00:48:29.590534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee289c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=659000000,duration_sec=70,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:29.591610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:29.592308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:32 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 00:48:31.586277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:33 started Oct 23 00:48:31.589951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee289e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=661000000,duration_sec=72,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:31.590610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:31.591045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:33 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:33.587134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:34 started Oct 23 00:48:33.589712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=660000000,duration_sec=74,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:33.590292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:33.590645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:34 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:35.588463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:35 started Oct 23 00:48:35.592064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=662000000,duration_sec=76,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:35.592959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:35.593543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:35 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:37.589510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:36 started Oct 23 00:48:37.593137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=664000000,duration_sec=78,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:37.593942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:37.594582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:36 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:39.590866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:37 started Oct 23 00:48:39.593890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=664000000,duration_sec=80,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:39.594485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:39.594853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:37 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:41.592478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:38 started Oct 23 00:48:41.596921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=666000000,duration_sec=82,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:41.597829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:41.598465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:38 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:48:43.593234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:39 started Oct 23 00:48:43.595871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=667000000,duration_sec=84,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:43.596438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:43.596775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:39 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:45.594819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:40 started Oct 23 00:48:45.597753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=668000000,duration_sec=86,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:45.598338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:45.598696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:40 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:47.596103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:41 started Oct 23 00:48:47.598790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=670000000,duration_sec=88,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:47.599495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:47.600156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:41 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:48:49.596606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:42 started Oct 23 00:48:49.601853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=670000000,duration_sec=90,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:49.602980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:49.603577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:42 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:48:51.598148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:43 started Oct 23 00:48:51.601234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=671000000,duration_sec=92,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:51.602206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:51.603088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:43 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:53.600019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:44 started Oct 23 00:48:53.603457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=673000000,duration_sec=94,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:53.604025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:53.604380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:44 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:55.600578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:45 started Oct 23 00:48:55.603784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=674000000,duration_sec=96,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:55.604842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:55.605393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:45 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:57.601893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:46 started Oct 23 00:48:57.605206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=676000000,duration_sec=98,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:57.605968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:57.606350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:46 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:48:59.603130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:47 started Oct 23 00:48:59.605909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=676000000,duration_sec=100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:48:59.606682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:48:59.607234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:47 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:01.603907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:48 started Oct 23 00:49:01.607878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=678000000,duration_sec=102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:01.608562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:01.609126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:48 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:49:03.604849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:49 started Oct 23 00:49:03.607298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=678000000,duration_sec=104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:03.607844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:03.608222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:49 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:05.605322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:50 started Oct 23 00:49:05.608019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=679000000,duration_sec=106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:05.608617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:05.608985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:50 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:07.607025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:51 started Oct 23 00:49:07.609382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=680000000,duration_sec=108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:07.609947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:07.610297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:51 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:09.607937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:52 started Oct 23 00:49:09.610557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=681000000,duration_sec=110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:09.611144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:09.611497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:52 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:11.609285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:53 started Oct 23 00:49:11.611791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=683000000,duration_sec=112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:11.612365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:11.612730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:53 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:13.610200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:54 started Oct 23 00:49:13.612972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=684000000,duration_sec=114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:13.613557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:13.613923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:54 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:15.610799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:55 started Oct 23 00:49:15.613527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=684000000,duration_sec=116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:15.614202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:15.614553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:55 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:17.611525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:56 started Oct 23 00:49:17.614609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=685000000,duration_sec=118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:17.615184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:17.615540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:56 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:19.613074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:57 started Oct 23 00:49:19.615669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=686000000,duration_sec=120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:19.616250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:19.616602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:57 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:21.614362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:58 started Oct 23 00:49:21.617316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=688000000,duration_sec=122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:21.617985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:21.618593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:58 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:23.616042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:59 started Oct 23 00:49:23.619069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=689000000,duration_sec=124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:23.619589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:23.619943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:59 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:25.616643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:60 started Oct 23 00:49:25.619178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=690000000,duration_sec=126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:25.619669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:25.620019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:60 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:27.617351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:61 started Oct 23 00:49:27.620013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=691000000,duration_sec=128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:27.620528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:27.620914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:61 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:29.618557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:62 started Oct 23 00:49:29.621176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=692000000,duration_sec=130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:29.621743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:29.622091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:62 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:31.620142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:63 started Oct 23 00:49:31.622765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=693000000,duration_sec=132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:31.623354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:31.623700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:63 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:33.621530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:64 started Oct 23 00:49:33.624151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=695000000,duration_sec=134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:33.624743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:33.625110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:64 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:35.622270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:65 started Oct 23 00:49:35.624883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=695000000,duration_sec=136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:35.625465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:35.625819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:65 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:36.661755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-038ff879-54e0-46e9-9ab4-515490841d48 admin admin] Resource Subnet a0952b7c-4e64-412e-af50-2047b7a58d06 updated (revision_number 0->1). Old fields: {'dns_nameservers': []} New fields: {'dns_nameservers': [DNSNameServer(address='8.8.8.8',order=0,subnet_id=a0952b7c-4e64-412e-af50-2047b7a58d06), DNSNameServer(address='8.8.4.4',order=1,subnet_id=a0952b7c-4e64-412e-af50-2047b7a58d06)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:49:36.662402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-038ff879-54e0-46e9-9ab4-515490841d48 admin admin] Publish callbacks [] for Subnet (a0952b7c-4e64-412e-af50-2047b7a58d06), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:49:37.623627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:66 started Oct 23 00:49:37.626253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=697000000,duration_sec=138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:37.626985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:37.627349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:66 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:39.624366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:67 started Oct 23 00:49:39.627017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=698000000,duration_sec=140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:39.627662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:39.628018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:67 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:41.625253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:68 started Oct 23 00:49:41.627896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=699000000,duration_sec=142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:41.628472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:41.628966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:68 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:43.626567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:69 started Oct 23 00:49:43.629006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=700000000,duration_sec=144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:43.629613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:43.629968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:69 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:45.627352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:70 started Oct 23 00:49:45.629743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=701000000,duration_sec=146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:45.630323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:45.630679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:70 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:47.628316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:71 started Oct 23 00:49:47.630950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=702000000,duration_sec=148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:47.631509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:47.631861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:71 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:49.629487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:72 started Oct 23 00:49:49.632070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=703000000,duration_sec=150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:49.632760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:49.633140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:72 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:51.631045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:73 started Oct 23 00:49:51.633774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=704000000,duration_sec=152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:51.634337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:51.634682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:73 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:49:53.632783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:74 started Oct 23 00:49:53.635908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=706000000,duration_sec=154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:53.636490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:53.636880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:74 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:49:55.633365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:75 started Oct 23 00:49:55.636921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=707000000,duration_sec=156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:55.637453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:55.637837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:75 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:49:57.634614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:76 started Oct 23 00:49:57.637728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=708000000,duration_sec=158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:57.638569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:57.639540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:76 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:49:59.635964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:77 started Oct 23 00:49:59.638422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=709000000,duration_sec=160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:49:59.639266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:49:59.639620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:77 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:01.637537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:78 started Oct 23 00:50:01.640352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=711000000,duration_sec=162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:01.640963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:01.641320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:78 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:03.638636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:79 started Oct 23 00:50:03.641376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=712000000,duration_sec=164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:03.641961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:03.642307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:79 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:05.639363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:80 started Oct 23 00:50:05.641964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=713000000,duration_sec=166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:05.642543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:05.642921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:80 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:07.640142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:81 started Oct 23 00:50:07.642780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee28fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=714000000,duration_sec=168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:07.643359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:07.643719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:81 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:09.641201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:82 started Oct 23 00:50:09.644207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2900,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=714000000,duration_sec=170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:09.644813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:09.645170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:82 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:11.642284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:83 started Oct 23 00:50:11.645267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2902,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=716000000,duration_sec=172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:11.645875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:11.646225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:83 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:13.644224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:84 started Oct 23 00:50:13.648315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2904,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=718000000,duration_sec=174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:13.649234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:13.649757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:84 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:50:15.645392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:85 started Oct 23 00:50:15.647785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2906,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=719000000,duration_sec=176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:15.648353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:15.648751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:85 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:17.646015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:86 started Oct 23 00:50:17.648581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2908,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=719000000,duration_sec=178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:17.649165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:17.649516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:86 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:19.647057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:87 started Oct 23 00:50:19.649660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee290a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=720000000,duration_sec=180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:19.650236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:19.650590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:87 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:21.648080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:88 started Oct 23 00:50:21.650930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee290c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=721000000,duration_sec=182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:21.651572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:21.651920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:88 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:23.649495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:89 started Oct 23 00:50:23.652116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee290e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=723000000,duration_sec=184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:23.652824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:23.653199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:89 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:25.650329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:90 started Oct 23 00:50:25.652888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2910,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=724000000,duration_sec=186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:25.653459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:25.653811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:90 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:27.651175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:91 started Oct 23 00:50:27.653821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2912,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=724000000,duration_sec=188,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:27.654406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:27.654752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:91 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:29.652179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:92 started Oct 23 00:50:29.654815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2914,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=726000000,duration_sec=190,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:29.655512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:29.655872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:92 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:31.653661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:93 started Oct 23 00:50:31.657007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2916,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=727000000,duration_sec=192,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:31.657592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:31.657940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:93 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:50:33.655094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:94 started Oct 23 00:50:33.657766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2918,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=728000000,duration_sec=194,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:33.658336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:33.658946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:94 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:35.655847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:95 started Oct 23 00:50:35.658410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee291a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=729000000,duration_sec=196,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:35.658995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:35.659369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:95 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:37.656586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:96 started Oct 23 00:50:37.659257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee291c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=730000000,duration_sec=198,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:37.659862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:37.660247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:37.899554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1ae53e8c-a371-47b0-84db-544594820a71 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:50:37Z,description='',dns_domain=None,id=2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd,mtu=1500,name='shared',project_id='2d2a10b90d4949fc9a5b267280f9f9c5',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd),segments=[NetworkSegment(1985ffcf-cc5f-4e68-9fb5-e5b651a8883a)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:50:37Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:50:37.899937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1ae53e8c-a371-47b0-84db-544594820a71 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-1ae53e8c-a371-47b0-84db-544594820a71 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd with segmentation id not found. Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:50:37.978594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:50:37.979677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:50:37.979677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:50:37.979677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:50:37.979677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd with segmentation id not found. Oct 23 00:50:37.979677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:50:39.657623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:97 started Oct 23 00:50:39.660206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee291e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=731000000,duration_sec=200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:39.660825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:39.661194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:41.219181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5b56f48f-1b0c-4dc9-8451-c50b3f47eddc admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(5efbe972-941d-4e76-9c9f-ea0dc7cdb2e0)],cidr=192.168.233.0/24,created_at=2022-10-23T00:50:41Z,description='shared-subnet',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=192.168.233.1,host_routes=[],id=87b0d5d6-38a9-47a1-812d-6c6a0f132a45,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='shared-subnet',network_id=2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd,project_id='2d2a10b90d4949fc9a5b267280f9f9c5',revision_number=0,segment_id=,service_types=[],shared=True,subnetpool_id=,updated_at=2022-10-23T00:50:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:50:41.219862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5b56f48f-1b0c-4dc9-8451-c50b3f47eddc admin admin] Publish callbacks [] for Subnet (87b0d5d6-38a9-47a1-812d-6c6a0f132a45), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:50:41.658941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:98 started Oct 23 00:50:41.661608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2920,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=732000000,duration_sec=202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:41.662222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:41.662581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:41.878927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6036c160-eca3-49d7-926d-871e205cae36 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:50:41Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=87cfa4c1-a876-469a-b6ca-e739a6b2f813,mac_address=fa:16:3e:38:d9:31,name='',network_id=2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd,numa_affinity_policy=,project_id='2d2a10b90d4949fc9a5b267280f9f9c5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(87cfa4c1-a876-469a-b6ca-e739a6b2f813),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:50:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:50:41.879301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6036c160-eca3-49d7-926d-871e205cae36 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (87cfa4c1-a876-469a-b6ca-e739a6b2f813), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:50:42.103740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6036c160-eca3-49d7-926d-871e205cae36 None None] Resource Port 87cfa4c1-a876-469a-b6ca-e739a6b2f813 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=87cfa4c1-a876-469a-b6ca-e739a6b2f813,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=87cfa4c1-a876-469a-b6ca-e739a6b2f813,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=87cfa4c1-a876-469a-b6ca-e739a6b2f813,segment=NetworkSegment(1985ffcf-cc5f-4e68-9fb5-e5b651a8883a),segment_id=1985ffcf-cc5f-4e68-9fb5-e5b651a8883a)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:50:42.104144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6036c160-eca3-49d7-926d-871e205cae36 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (87cfa4c1-a876-469a-b6ca-e739a6b2f813), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:50:42.185333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["87c157f1-3528-4141-9280-62ef49b00499","insert","tap87cfa4c1-a8",["set",[]],["map",[["attached-mac","fa:16:3e:38:d9:31"],["iface-id","87cfa4c1-a876-469a-b6ca-e739a6b2f813"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:50:42.208556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["87c157f1-3528-4141-9280-62ef49b00499","old",null,["set",[]],null],["","new","tap87cfa4c1-a8",5,["map",[["attached-mac","fa:16:3e:38:d9:31"],["iface-id","87cfa4c1-a876-469a-b6ca-e739a6b2f813"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:50:43.172012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9dde5745-eb55-4b3c-a0c7-30175d262b0a None None] Resource Port 87cfa4c1-a876-469a-b6ca-e739a6b2f813 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:50:43.172670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9dde5745-eb55-4b3c-a0c7-30175d262b0a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (87cfa4c1-a876-469a-b6ca-e739a6b2f813), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:50:43.660219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:99 started Oct 23 00:50:43.663284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2922,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=734000000,duration_sec=204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:43.663872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:43.664579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:99 - starting polling. Elapsed:0.005 Oct 23 00:50:43.665906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:50:43.667265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:99 - port information retrieved. Elapsed:0.007 Oct 23 00:50:43.667597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'36027a75-3b26-4728-a464-23e4dbba5d4a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 'added': {'87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 'removed': set(), 'updated': {'87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:50:43.668185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd', 'network_id': '2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd', 'port_id': '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'mac_address': 'fa:16:3e:38:d9:31', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 361, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '87b0d5d6-38a9-47a1-812d-6c6a0f132a45', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:50:43.669468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 87cfa4c1-a876-469a-b6ca-e739a6b2f813 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:50:43.670019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 87cfa4c1-a876-469a-b6ca-e739a6b2f813 updated. Details: {'device': '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd', 'network_id': '2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd', 'port_id': '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'mac_address': 'fa:16:3e:38:d9:31', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 361, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '87b0d5d6-38a9-47a1-812d-6c6a0f132a45', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:50:43.670365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 3 as local vlan for net-id=2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd, seg-id=361 Oct 23 00:50:43.673247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1321192b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4457), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4099}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:43.675634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2924,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4099)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4457}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:43.676634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap87cfa4c1-a8, col_values=(('tag', 3),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:50:43.677112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap87cfa4c1-a8, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:50:43.677547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap87cfa4c1-a8, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:50:43.681791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap87cfa4c1-a8, col_values=(('other_config', {'net_uuid': '2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '3', 'segmentation_id': '361'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:50:43.689699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2926,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:43.690028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:99 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.022 Oct 23 00:50:43.690591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:50:43.690879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'87cfa4c1-a876-469a-b6ca-e739a6b2f813'} Oct 23 00:50:43.692045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:50:43.692320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:50:43.699195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:50:43.737020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[714a8689-3a0f-47f7-978b-3c0d5a986d25]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:50:43.737694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:99 - agent port security group processed in 0.070 Oct 23 00:50:43.738337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 87cfa4c1-a876-469a-b6ca-e739a6b2f813 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:50:43.869977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['87cfa4c1-a876-469a-b6ca-e739a6b2f813'] and devices down [] completed. Oct 23 00:50:43.870492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:99 - ports processed. Elapsed:0.210 Oct 23 00:50:43.871070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.211 Oct 23 00:50:45.660991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:100 started Oct 23 00:50:45.663670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2928,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=734000000,duration_sec=206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:45.664249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:45.664603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:47.662400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:101 started Oct 23 00:50:47.665083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee292a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=736000000,duration_sec=208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:47.665633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:47.665982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:49.663421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:102 started Oct 23 00:50:49.666110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee292c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=737000000,duration_sec=210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:49.666665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:49.667009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:51.664278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:103 started Oct 23 00:50:51.667000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee292e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=738000000,duration_sec=212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:51.667674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:51.668024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:103 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:53.665719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:104 started Oct 23 00:50:53.668443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2930,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=739000000,duration_sec=214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:53.669089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:53.669447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:104 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:55.667577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:105 started Oct 23 00:50:55.671062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2932,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=741000000,duration_sec=216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:55.671755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:55.672196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:105 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:50:57.668912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:106 started Oct 23 00:50:57.671587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2934,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=742000000,duration_sec=218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:57.672160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:57.672513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:106 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:50:59.670115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:107 started Oct 23 00:50:59.673136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2936,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=744000000,duration_sec=220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:50:59.673720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:50:59.674078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:107 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:01.671316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:108 started Oct 23 00:51:01.674013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2938,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=745000000,duration_sec=222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:01.674595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:01.674952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:108 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:03.673150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:109 started Oct 23 00:51:03.676667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee293a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=747000000,duration_sec=224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:03.677313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:03.677673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:109 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:51:05.674236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:110 started Oct 23 00:51:05.676939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee293c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=748000000,duration_sec=226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:05.677525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:05.677877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:110 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:07.675254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:111 started Oct 23 00:51:07.678306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee293e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=749000000,duration_sec=228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:07.678888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:07.679245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:111 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:09.676584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:112 started Oct 23 00:51:09.679285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2940,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=750000000,duration_sec=230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:09.679853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:09.680204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:112 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:11.677446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:113 started Oct 23 00:51:11.680029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2942,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=751000000,duration_sec=232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:11.680606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:11.680979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:113 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:13.678134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:114 started Oct 23 00:51:13.680694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2944,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=751000000,duration_sec=234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:13.681293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:13.681642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:114 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:15.678839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:115 started Oct 23 00:51:15.681558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2946,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=752000000,duration_sec=236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:15.682128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:15.682488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:115 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:17.680247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:116 started Oct 23 00:51:17.682840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2948,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=754000000,duration_sec=238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:17.683406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:17.683788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:116 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:19.681435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:117 started Oct 23 00:51:19.684406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee294a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=755000000,duration_sec=240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:19.685052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:19.685433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:117 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:21.682382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:118 started Oct 23 00:51:21.685018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee294c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=756000000,duration_sec=242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:21.685600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:21.685949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:118 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:23.683619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:119 started Oct 23 00:51:23.687068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee294e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=757000000,duration_sec=244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:23.688308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:23.688684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:119 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:51:25.684710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:120 started Oct 23 00:51:25.687932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2950,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=758000000,duration_sec=246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:25.688517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:25.688921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:120 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:27.685960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:121 started Oct 23 00:51:27.688670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2952,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=759000000,duration_sec=248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:27.689293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:27.689650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:121 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:29.687754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:122 started Oct 23 00:51:29.690600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2954,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=761000000,duration_sec=250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:29.691194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:29.691547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:122 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:31.688746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:123 started Oct 23 00:51:31.691393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2956,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=762000000,duration_sec=252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:31.691969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:31.692322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:123 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:33.689489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:124 started Oct 23 00:51:33.696591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2958,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=763000000,duration_sec=254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:33.697221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:33.697573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:124 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 00:51:35.691110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:125 started Oct 23 00:51:35.693774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee295a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=765000000,duration_sec=256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:35.694346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:35.694700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:125 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:37.692775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:126 started Oct 23 00:51:37.695446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee295c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=766000000,duration_sec=258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:37.696030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:37.696385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:126 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:39.694237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:127 started Oct 23 00:51:39.696947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee295e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=768000000,duration_sec=260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:39.697526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:39.697891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:127 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:41.695338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:128 started Oct 23 00:51:41.698155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2960,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=769000000,duration_sec=262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:41.698705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:41.699052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:128 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:43.696037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:129 started Oct 23 00:51:43.698727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2962,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=769000000,duration_sec=264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:43.699325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:43.699686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:129 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:45.697042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:130 started Oct 23 00:51:45.700110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2964,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=770000000,duration_sec=266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:45.700709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:45.701089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:130 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:47.697810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:131 started Oct 23 00:51:47.700489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2966,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=771000000,duration_sec=268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:47.701092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:47.701443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:131 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:49.698619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:132 started Oct 23 00:51:49.701543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2968,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=772000000,duration_sec=270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:49.702119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:49.702574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:132 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:51.700136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:133 started Oct 23 00:51:51.703974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee296a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=774000000,duration_sec=272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:51.704695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:51.705048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:133 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:51:53.700704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:134 started Oct 23 00:51:53.703184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee296c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=774000000,duration_sec=274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:53.703807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:53.704166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:134 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:55.702404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:135 started Oct 23 00:51:55.705402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee296e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=776000000,duration_sec=276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:55.705981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:55.706334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:135 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:57.703840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:136 started Oct 23 00:51:57.706398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2970,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=777000000,duration_sec=278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:57.706998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:57.707328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:136 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:51:57.951863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:51:57Z,description='Default security group',id=c4cdce8f-5b0a-4dee-a868-f70f94866f96,is_default=True,name='default',project_id='bfdd235c04cf4b388f1404b60edb0a46',revision_number=1,rules=[SecurityGroupRule(180385fc-7b4c-4c4a-bca5-65581e8b72f5),SecurityGroupRule(428d2544-1b4c-4e71-ad42-cec817aa913e),SecurityGroupRule(8ad3594d-b1c7-4fb6-b814-d43bd42ec824),SecurityGroupRule(a7660e80-4337-430c-89d4-0f674496967c)],shared=False,stateful=True,updated_at=2022-10-23T00:51:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:51:57.952319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (c4cdce8f-5b0a-4dee-a868-f70f94866f96), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:57.953038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:51:57Z,description=,direction='egress',ethertype='IPv4',id=180385fc-7b4c-4c4a-bca5-65581e8b72f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bfdd235c04cf4b388f1404b60edb0a46',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4cdce8f-5b0a-4dee-a868-f70f94866f96,updated_at=2022-10-23T00:51:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:51:57.953464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (180385fc-7b4c-4c4a-bca5-65581e8b72f5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:57.953915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:57.954678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:51:57Z,description=,direction='egress',ethertype='IPv6',id=428d2544-1b4c-4e71-ad42-cec817aa913e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bfdd235c04cf4b388f1404b60edb0a46',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4cdce8f-5b0a-4dee-a868-f70f94866f96,updated_at=2022-10-23T00:51:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:51:57.955128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (428d2544-1b4c-4e71-ad42-cec817aa913e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:57.955543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:57.956259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:51:57Z,description=,direction='ingress',ethertype='IPv4',id=8ad3594d-b1c7-4fb6-b814-d43bd42ec824,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bfdd235c04cf4b388f1404b60edb0a46',protocol=,remote_address_group_id=,remote_group_id=c4cdce8f-5b0a-4dee-a868-f70f94866f96,remote_ip_prefix=,revision_number=0,security_group_id=c4cdce8f-5b0a-4dee-a868-f70f94866f96,updated_at=2022-10-23T00:51:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:51:57.956673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8ad3594d-b1c7-4fb6-b814-d43bd42ec824), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:57.957089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:57.957802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:51:57Z,description=,direction='ingress',ethertype='IPv6',id=a7660e80-4337-430c-89d4-0f674496967c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bfdd235c04cf4b388f1404b60edb0a46',protocol=,remote_address_group_id=,remote_group_id=c4cdce8f-5b0a-4dee-a868-f70f94866f96,remote_ip_prefix=,revision_number=0,security_group_id=c4cdce8f-5b0a-4dee-a868-f70f94866f96,updated_at=2022-10-23T00:51:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:51:57.958241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a7660e80-4337-430c-89d4-0f674496967c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:57.958568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0bddc82b-128a-4319-bf1a-15ccd963cfe3 admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:58.175707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Resource SecurityGroup deleted: c4cdce8f-5b0a-4dee-a868-f70f94866f96 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:51:58.176102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (c4cdce8f-5b0a-4dee-a868-f70f94866f96), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:58.176601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c4cdce8f-5b0a-4dee-a868-f70f94866f96',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:51:58.199969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c4cdce8f-5b0a-4dee-a868-f70f94866f96',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:51:58.200347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Resource SecurityGroupRule deleted: 180385fc-7b4c-4c4a-bca5-65581e8b72f5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:51:58.200964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (180385fc-7b4c-4c4a-bca5-65581e8b72f5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:58.201300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:58.201680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Resource SecurityGroupRule deleted: 428d2544-1b4c-4e71-ad42-cec817aa913e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:51:58.202370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (428d2544-1b4c-4e71-ad42-cec817aa913e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:58.202370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:58.202641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Resource SecurityGroupRule deleted: 8ad3594d-b1c7-4fb6-b814-d43bd42ec824 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:51:58.202973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8ad3594d-b1c7-4fb6-b814-d43bd42ec824), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:58.203299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:58.203655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Resource SecurityGroupRule deleted: a7660e80-4337-430c-89d4-0f674496967c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:51:58.204040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a7660e80-4337-430c-89d4-0f674496967c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:51:58.204282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2242eb6-b555-4eb2-a93a-1424940fc5ad admin admin] Security group rule updated ['c4cdce8f-5b0a-4dee-a868-f70f94866f96'] Oct 23 00:51:59.704752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:137 started Oct 23 00:51:59.707435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2972,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=778000000,duration_sec=280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:51:59.708021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:51:59.708372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:137 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:52:01.705960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:138 started Oct 23 00:52:01.708629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2974,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=779000000,duration_sec=282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:01.709251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:01.709623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:138 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:52:03.706928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:139 started Oct 23 00:52:03.709441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2976,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=780000000,duration_sec=284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:03.710002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:03.710353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:139 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:52:05.707883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:140 started Oct 23 00:52:05.715376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2978,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=781000000,duration_sec=286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:05.715980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:05.716325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:140 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 00:52:07.709189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:141 started Oct 23 00:52:07.712511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee297a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=783000000,duration_sec=288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:07.713128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:07.713479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:141 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:52:09.710018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:142 started Oct 23 00:52:09.712663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee297c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=783000000,duration_sec=290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:09.713249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:09.713599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:142 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:52:11.711455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:143 started Oct 23 00:52:11.715894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee297e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=786000000,duration_sec=292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:11.716920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:11.717497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:143 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:13.712775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:144 started Oct 23 00:52:13.716798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2980,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=786000000,duration_sec=294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:13.717716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:13.718278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:144 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:15.713940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:145 started Oct 23 00:52:15.718111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2982,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=788000000,duration_sec=296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:15.719038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:15.719618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:145 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:17.714993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:146 started Oct 23 00:52:17.719221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2984,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=789000000,duration_sec=298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:17.720156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:17.720778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:146 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:19.716097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:147 started Oct 23 00:52:19.720610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2986,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=790000000,duration_sec=300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:19.721637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:19.722222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:147 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:21.717533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:148 started Oct 23 00:52:21.721707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2988,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=791000000,duration_sec=302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:21.722700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:21.723267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:148 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:23.718226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:149 started Oct 23 00:52:23.720708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee298a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=791000000,duration_sec=304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:23.721336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:23.721687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:149 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:52:25.719340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:150 started Oct 23 00:52:25.723462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee298c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=793000000,duration_sec=306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:25.724455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:25.725088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:150 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:27.720956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:151 started Oct 23 00:52:27.725132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee298e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=795000000,duration_sec=308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:27.726070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:27.726661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:151 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:29.721875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:152 started Oct 23 00:52:29.726189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2990,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=796000000,duration_sec=310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:29.727130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:29.727710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:152 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:31.723351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:153 started Oct 23 00:52:31.727528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2992,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=797000000,duration_sec=312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:31.728468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:31.729103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:153 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:33.724458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:154 started Oct 23 00:52:33.727920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2994,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=798000000,duration_sec=314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:33.728703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:33.729198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:154 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:52:35.725332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:155 started Oct 23 00:52:35.729636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2996,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=799000000,duration_sec=316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:35.730586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:35.731506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:155 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:37.726857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:156 started Oct 23 00:52:37.731372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2998,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=801000000,duration_sec=318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:37.732780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:37.733369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:156 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:52:39.728271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:157 started Oct 23 00:52:39.732758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee299a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=802000000,duration_sec=320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:39.733746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:39.734326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:157 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:41.729192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:158 started Oct 23 00:52:41.731927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee299c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=803000000,duration_sec=322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:41.732514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:41.732901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:158 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:52:43.731109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:159 started Oct 23 00:52:43.735974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee299e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=806000000,duration_sec=324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:43.736961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:43.737586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:159 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:52:45.731596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:160 started Oct 23 00:52:45.734823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=805000000,duration_sec=326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:45.735411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:45.735763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:160 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:52:47.733500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:161 started Oct 23 00:52:47.737806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=808000000,duration_sec=328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:47.738736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:47.739317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:161 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:49.735179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:162 started Oct 23 00:52:49.739269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=809000000,duration_sec=330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:49.740208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:49.740788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:162 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:51.736243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:163 started Oct 23 00:52:51.740481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=810000000,duration_sec=332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:51.741488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:51.742070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:163 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:53.737404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:164 started Oct 23 00:52:53.740788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=811000000,duration_sec=334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:53.741673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:53.742133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:164 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:52:55.739057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:165 started Oct 23 00:52:55.743286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=813000000,duration_sec=336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:55.744226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:55.744799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:165 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:57.740871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:166 started Oct 23 00:52:57.745018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=815000000,duration_sec=338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:57.745959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:57.746529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:166 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:52:59.741925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:167 started Oct 23 00:52:59.746107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=816000000,duration_sec=340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:52:59.747034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:52:59.747603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:167 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:01.743759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:168 started Oct 23 00:53:01.747964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=818000000,duration_sec=342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:01.748935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:01.749571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:168 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:03.745235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:169 started Oct 23 00:53:03.749235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=819000000,duration_sec=344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:03.750218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:03.750796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:169 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:05.746755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:170 started Oct 23 00:53:05.750864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=821000000,duration_sec=346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:05.751764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:05.752226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:170 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:07.748432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:171 started Oct 23 00:53:07.752543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=822000000,duration_sec=348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:07.753415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:07.753980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:171 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:09.749833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:172 started Oct 23 00:53:09.754174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=824000000,duration_sec=350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:09.755107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:09.755676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:172 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:11.751334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:173 started Oct 23 00:53:11.756013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=826000000,duration_sec=352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:11.757007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:11.757587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:173 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:53:13.752479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:174 started Oct 23 00:53:13.756658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=826000000,duration_sec=354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:13.757688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:13.758318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:174 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:15.753767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:175 started Oct 23 00:53:15.757864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=828000000,duration_sec=356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:15.758862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:15.759440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:175 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:17.755039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:176 started Oct 23 00:53:17.759319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=829000000,duration_sec=358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:17.760633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:17.761256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:176 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:19.756123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:177 started Oct 23 00:53:19.761130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=830000000,duration_sec=360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:19.762116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:19.762684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:177 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:53:21.757393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:178 started Oct 23 00:53:21.761789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=831000000,duration_sec=362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:21.762721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:21.763295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:178 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:23.758008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:179 started Oct 23 00:53:23.760896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=831000000,duration_sec=364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:23.761466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:23.761835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:179 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:25.758649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:180 started Oct 23 00:53:25.762431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=833000000,duration_sec=366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:25.763037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:25.763990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:180 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:27.759717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:181 started Oct 23 00:53:27.764207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=834000000,duration_sec=368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:27.765233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:27.765792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:181 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:29.761239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:182 started Oct 23 00:53:29.771723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=835000000,duration_sec=370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:29.772784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:29.773335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:182 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:53:31.762091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:183 started Oct 23 00:53:31.766260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=836000000,duration_sec=372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:31.767230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:31.767807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:183 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:33.762603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:184 started Oct 23 00:53:33.765315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=836000000,duration_sec=374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:33.765938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:33.766287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:184 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:35.763784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:185 started Oct 23 00:53:35.767921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=838000000,duration_sec=376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:35.769066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:35.769689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:185 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:37.765317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:186 started Oct 23 00:53:37.768007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=839000000,duration_sec=378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:37.768668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:37.769046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:186 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:39.766920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:187 started Oct 23 00:53:39.771385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=841000000,duration_sec=380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:39.772166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:39.772616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:187 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:41.768405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:188 started Oct 23 00:53:41.771559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=842000000,duration_sec=382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:41.772182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:41.772542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:188 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:43.769910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:189 started Oct 23 00:53:43.772582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=843000000,duration_sec=384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:43.773493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:43.773855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:189 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:45.770684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:190 started Oct 23 00:53:45.773378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=844000000,duration_sec=386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:45.773943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:45.774294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:190 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:47.771735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:191 started Oct 23 00:53:47.774397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=845000000,duration_sec=388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:47.775005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:47.775364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:191 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:49.773084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:192 started Oct 23 00:53:49.775737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=846000000,duration_sec=390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:49.776299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:49.776648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:192 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:51.774406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:193 started Oct 23 00:53:51.777024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=848000000,duration_sec=392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:51.777614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:51.777972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:193 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:53:53.775371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:194 started Oct 23 00:53:53.779542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=849000000,duration_sec=394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:53.780582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:53.781205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:194 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:55.776503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:195 started Oct 23 00:53:55.780802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=850000000,duration_sec=396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:55.781767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:55.782413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:195 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:57.778144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:196 started Oct 23 00:53:57.782342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=852000000,duration_sec=398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:57.783317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:57.783871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:196 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:53:59.779991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:197 started Oct 23 00:53:59.784206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=854000000,duration_sec=400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:53:59.785709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:53:59.786132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:197 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:54:01.781518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:198 started Oct 23 00:54:01.786140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=855000000,duration_sec=402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:01.787139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:01.787730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:198 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:54:03.782713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:199 started Oct 23 00:54:03.793947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=856000000,duration_sec=404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:03.794895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:03.795470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:199 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 00:54:05.784141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:200 started Oct 23 00:54:05.788337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=858000000,duration_sec=406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:05.789315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:05.789889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:200 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:07.784994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:201 started Oct 23 00:54:07.787956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=859000000,duration_sec=408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:07.788638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:07.789024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:201 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:09.786857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:202 started Oct 23 00:54:09.791804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=862000000,duration_sec=410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:09.792817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:09.793425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:202 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:54:11.788330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:203 started Oct 23 00:54:11.792788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=862000000,duration_sec=412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:11.793757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:11.794348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:203 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:13.789488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:204 started Oct 23 00:54:13.793600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=863000000,duration_sec=414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:13.794574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:13.795149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:204 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:15.790589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:205 started Oct 23 00:54:15.795083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=865000000,duration_sec=416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:15.796030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:15.796614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:205 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:17.792270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:206 started Oct 23 00:54:17.796636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=866000000,duration_sec=418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:17.797617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:17.798194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:206 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:19.793961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:207 started Oct 23 00:54:19.798486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee29fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=868000000,duration_sec=420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:19.799425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:19.800077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:207 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:21.795789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:208 started Oct 23 00:54:21.799903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=870000000,duration_sec=422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:21.800880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:21.801447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:208 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:23.796828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:209 started Oct 23 00:54:23.800910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=870000000,duration_sec=424,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:23.801785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:23.802405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:209 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:25.797422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:210 started Oct 23 00:54:25.800074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=871000000,duration_sec=426,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:25.800690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:25.801073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:210 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:27.799259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:211 started Oct 23 00:54:27.803475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=873000000,duration_sec=428,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:27.804416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:27.805052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:211 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:54:29.800447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:212 started Oct 23 00:54:29.804214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=874000000,duration_sec=430,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:29.805068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:29.805570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:212 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:54:31.802030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:213 started Oct 23 00:54:31.804770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=876000000,duration_sec=432,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:31.805370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:31.805725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:213 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:33.802874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:214 started Oct 23 00:54:33.805889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=876000000,duration_sec=434,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:33.806466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:33.806823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:214 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:35.803575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:215 started Oct 23 00:54:35.806658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=877000000,duration_sec=436,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:35.807244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:35.807594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:215 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:37.804582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:216 started Oct 23 00:54:37.807446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=878000000,duration_sec=438,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:37.808016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:37.808524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:216 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:39.805778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:217 started Oct 23 00:54:39.808763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=879000000,duration_sec=440,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:39.810270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:39.810609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:217 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:54:41.807075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:218 started Oct 23 00:54:41.810754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=881000000,duration_sec=442,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:41.811426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:41.812194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:218 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:54:43.807917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:219 started Oct 23 00:54:43.811342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=882000000,duration_sec=444,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:43.812292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:43.813004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:219 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:54:45.809607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:220 started Oct 23 00:54:45.812272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=883000000,duration_sec=446,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:45.813088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:45.813435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:220 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:47.811083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:221 started Oct 23 00:54:47.814128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=885000000,duration_sec=448,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:47.814701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:47.815056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:221 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:49.812134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:222 started Oct 23 00:54:49.815061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=886000000,duration_sec=450,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:49.815665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:49.816015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:222 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:51.812757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:223 started Oct 23 00:54:51.815454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=886000000,duration_sec=452,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:51.816028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:51.816378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:223 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:53.813317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:224 started Oct 23 00:54:53.816102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=887000000,duration_sec=454,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:53.816691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:53.817080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:224 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:55.814211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:225 started Oct 23 00:54:55.817362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=888000000,duration_sec=456,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:55.817975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:55.818361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:225 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:57.815525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:226 started Oct 23 00:54:57.818283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=889000000,duration_sec=458,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:57.818881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:57.819227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:226 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:54:59.816347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:227 started Oct 23 00:54:59.819035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=890000000,duration_sec=460,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:54:59.819655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:54:59.820012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:227 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:55:01.817407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:228 started Oct 23 00:55:01.819980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=891000000,duration_sec=462,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:01.820547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:01.820955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:228 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:55:03.818172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:229 started Oct 23 00:55:03.820606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=891000000,duration_sec=464,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:03.821200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:03.821573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:229 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:55:05.819363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:230 started Oct 23 00:55:05.822042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=893000000,duration_sec=466,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:05.822614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:05.822963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:230 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:55:07.820458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:231 started Oct 23 00:55:07.823229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=894000000,duration_sec=468,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:07.823803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:07.824154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:231 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:55:09.821976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:232 started Oct 23 00:55:09.824638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=895000000,duration_sec=470,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:09.825241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:09.825596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:232 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:55:11.822550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:233 started Oct 23 00:55:11.825235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=896000000,duration_sec=472,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:11.825800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:11.826146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:233 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:55:13.823508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:234 started Oct 23 00:55:13.827128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=898000000,duration_sec=474,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:13.828220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:13.828894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:234 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:55:15.825089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:235 started Oct 23 00:55:15.829388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=899000000,duration_sec=476,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:15.830159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:15.830691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:235 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:55:17.826003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:236 started Oct 23 00:55:17.830278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=901000000,duration_sec=478,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:17.831115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:17.831256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:236 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:55:18.339938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:18Z,description='Default security group',id=f3ce37d9-177c-4e87-927f-4bd88426ffae,is_default=True,name='default',project_id='29c3589cf3024c1083bc90f33ab61c00',revision_number=1,rules=[SecurityGroupRule(3580a2f6-b38b-4890-a3a0-6dc945389bda),SecurityGroupRule(4acd02be-9ec9-4fa7-8127-b5809a87d4b2),SecurityGroupRule(5ebd49f9-f60e-4864-9f91-57a214bbfb8f),SecurityGroupRule(b9ee24e6-e00d-4116-baed-f0ecbaa9eb43)],shared=False,stateful=True,updated_at=2022-10-23T00:55:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:18.340760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (f3ce37d9-177c-4e87-927f-4bd88426ffae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:18.341734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:18Z,description=,direction='egress',ethertype='IPv6',id=3580a2f6-b38b-4890-a3a0-6dc945389bda,normalized_cidr=None,port_range_max=,port_range_min=,project_id='29c3589cf3024c1083bc90f33ab61c00',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f3ce37d9-177c-4e87-927f-4bd88426ffae,updated_at=2022-10-23T00:55:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:18.342283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3580a2f6-b38b-4890-a3a0-6dc945389bda), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:18.342868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:55:18.345089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:18Z,description=,direction='ingress',ethertype='IPv6',id=4acd02be-9ec9-4fa7-8127-b5809a87d4b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='29c3589cf3024c1083bc90f33ab61c00',protocol=,remote_address_group_id=,remote_group_id=f3ce37d9-177c-4e87-927f-4bd88426ffae,remote_ip_prefix=,revision_number=0,security_group_id=f3ce37d9-177c-4e87-927f-4bd88426ffae,updated_at=2022-10-23T00:55:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:18.345546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4acd02be-9ec9-4fa7-8127-b5809a87d4b2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:18.346218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:55:18.347620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:18Z,description=,direction='ingress',ethertype='IPv4',id=5ebd49f9-f60e-4864-9f91-57a214bbfb8f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='29c3589cf3024c1083bc90f33ab61c00',protocol=,remote_address_group_id=,remote_group_id=f3ce37d9-177c-4e87-927f-4bd88426ffae,remote_ip_prefix=,revision_number=0,security_group_id=f3ce37d9-177c-4e87-927f-4bd88426ffae,updated_at=2022-10-23T00:55:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:18.348314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5ebd49f9-f60e-4864-9f91-57a214bbfb8f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:18.349307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:55:18.350041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:18Z,description=,direction='egress',ethertype='IPv4',id=b9ee24e6-e00d-4116-baed-f0ecbaa9eb43,normalized_cidr=None,port_range_max=,port_range_min=,project_id='29c3589cf3024c1083bc90f33ab61c00',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f3ce37d9-177c-4e87-927f-4bd88426ffae,updated_at=2022-10-23T00:55:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:18.350577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b9ee24e6-e00d-4116-baed-f0ecbaa9eb43), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:18.351023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:55:18.463770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:55:18Z,description='',dns_domain=None,id=af018619-0331-4553-bdbc-b12c91da85cf,mtu=1500,name='tempest-DeleteServersTestJSON-2093722459-network',project_id='29c3589cf3024c1083bc90f33ab61c00',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(af018619-0331-4553-bdbc-b12c91da85cf),segments=[NetworkSegment(b638209f-90ba-44ee-80d1-50cdacceb6dc)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:55:18Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:18.464668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (af018619-0331-4553-bdbc-b12c91da85cf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-344666e5-b9be-40bb-83bf-48777b112a49 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network af018619-0331-4553-bdbc-b12c91da85cf with segmentation id not found. Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:55:18.550543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:55:18.551638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:55:18.551638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:55:18.551638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:55:18.551638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network af018619-0331-4553-bdbc-b12c91da85cf with segmentation id not found. Oct 23 00:55:18.551638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:55:18.852940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f44f855b-4bd2-4e62-a6cb-ddc01ad2a1ce admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(8b07cfcd-4511-4a42-9cea-3f7b800d9692)],cidr=172.20.0.0/28,created_at=2022-10-23T00:55:18Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=6f0acb91-496c-45f4-acb5-584ff234a755,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-DeleteServersTestJSON-2093722459-subnet',network_id=af018619-0331-4553-bdbc-b12c91da85cf,project_id='29c3589cf3024c1083bc90f33ab61c00',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:55:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:18.854151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f44f855b-4bd2-4e62-a6cb-ddc01ad2a1ce admin admin] Publish callbacks [] for Subnet (6f0acb91-496c-45f4-acb5-584ff234a755), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.544298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6e2022e1-727b-409e-ab75-c85149a324ee None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:19Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-af018619-0331-4553-bdbc-b12c91da85cf',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=81a4888a-a035-4442-91ea-dd123a7c1c39,mac_address=fa:16:3e:b6:cd:c7,name='',network_id=af018619-0331-4553-bdbc-b12c91da85cf,numa_affinity_policy=,project_id='29c3589cf3024c1083bc90f33ab61c00',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(81a4888a-a035-4442-91ea-dd123a7c1c39),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:19.545232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6e2022e1-727b-409e-ab75-c85149a324ee None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (81a4888a-a035-4442-91ea-dd123a7c1c39), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.707985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:19Z,description='Default security group',id=cb50e658-4e19-4f1f-805f-093dd827acaf,is_default=True,name='default',project_id='2a9697845193443ea394c1b480b6b769',revision_number=1,rules=[SecurityGroupRule(1e75bc3f-4777-43a2-8855-8a48add3aac2),SecurityGroupRule(57023bc4-30c2-48e4-9581-cbb190570b07),SecurityGroupRule(aa8520f3-b8f3-46c2-8726-a31d0f33e4d6),SecurityGroupRule(b449bf2a-5d76-4337-89f2-997f28858ff2)],shared=False,stateful=True,updated_at=2022-10-23T00:55:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:19.709072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (cb50e658-4e19-4f1f-805f-093dd827acaf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.709983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:19Z,description=,direction='egress',ethertype='IPv4',id=1e75bc3f-4777-43a2-8855-8a48add3aac2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb50e658-4e19-4f1f-805f-093dd827acaf,updated_at=2022-10-23T00:55:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:19.710518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1e75bc3f-4777-43a2-8855-8a48add3aac2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.711018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 00:55:19.711852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:19Z,description=,direction='ingress',ethertype='IPv6',id=57023bc4-30c2-48e4-9581-cbb190570b07,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=cb50e658-4e19-4f1f-805f-093dd827acaf,remote_ip_prefix=,revision_number=0,security_group_id=cb50e658-4e19-4f1f-805f-093dd827acaf,updated_at=2022-10-23T00:55:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:19.712372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (57023bc4-30c2-48e4-9581-cbb190570b07), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.712880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 00:55:19.713923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:19Z,description=,direction='ingress',ethertype='IPv4',id=aa8520f3-b8f3-46c2-8726-a31d0f33e4d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=cb50e658-4e19-4f1f-805f-093dd827acaf,remote_ip_prefix=,revision_number=0,security_group_id=cb50e658-4e19-4f1f-805f-093dd827acaf,updated_at=2022-10-23T00:55:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:19.714459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (aa8520f3-b8f3-46c2-8726-a31d0f33e4d6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.714942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 00:55:19.715740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:19Z,description=,direction='egress',ethertype='IPv6',id=b449bf2a-5d76-4337-89f2-997f28858ff2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb50e658-4e19-4f1f-805f-093dd827acaf,updated_at=2022-10-23T00:55:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:19.716255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b449bf2a-5d76-4337-89f2-997f28858ff2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.716738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 00:55:19.826925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:237 started Oct 23 00:55:19.830766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=901000000,duration_sec=480,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:19.831415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:19.831846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:237 - starting polling. Elapsed:0.005 Oct 23 00:55:19.833797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:19.835244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:237 - port information retrieved. Elapsed:0.008 Oct 23 00:55:19.835843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:237 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 00:55:19.936573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6e2022e1-727b-409e-ab75-c85149a324ee None None] Resource Port 81a4888a-a035-4442-91ea-dd123a7c1c39 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=81a4888a-a035-4442-91ea-dd123a7c1c39,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=81a4888a-a035-4442-91ea-dd123a7c1c39,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=81a4888a-a035-4442-91ea-dd123a7c1c39,segment=NetworkSegment(b638209f-90ba-44ee-80d1-50cdacceb6dc),segment_id=b638209f-90ba-44ee-80d1-50cdacceb6dc)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:19.938443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6e2022e1-727b-409e-ab75-c85149a324ee None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (81a4888a-a035-4442-91ea-dd123a7c1c39), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:20.185222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a3e3d4c7-302d-4f0f-b6c0-14e994ff9bae","insert","tap81a4888a-a0",["set",[]],["map",[["attached-mac","fa:16:3e:b6:cd:c7"],["iface-id","81a4888a-a035-4442-91ea-dd123a7c1c39"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:20.283543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a3e3d4c7-302d-4f0f-b6c0-14e994ff9bae","old",null,["set",[]],null],["","new","tap81a4888a-a0",6,["map",[["attached-mac","fa:16:3e:b6:cd:c7"],["iface-id","81a4888a-a035-4442-91ea-dd123a7c1c39"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:20.500603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:55:19Z,description='',dns_domain=None,id=6e24fc8d-42d5-4d11-b06b-37a4738231b0,mtu=1500,name='tempest-AttachVolumeTestJSON-363803032-network',project_id='2a9697845193443ea394c1b480b6b769',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(6e24fc8d-42d5-4d11-b06b-37a4738231b0),segments=[NetworkSegment(6c7f3988-5c29-4b49-bf43-a45d839e2e81)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:55:19Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:20.500603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (6e24fc8d-42d5-4d11-b06b-37a4738231b0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:20.693734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f2a28243-03d6-49dc-ba8d-c066aa35c8c9 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:19Z,data_plane_status=None,description='',device_id='2c238434-bfef-4fde-aac0-cae3ae6aa742',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,mac_address=fa:16:3e:6d:af:6d,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(cfbaf355-dc65-4e70-a31f-49dfe300f3d3),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:20.694116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f2a28243-03d6-49dc-ba8d-c066aa35c8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cfbaf355-dc65-4e70-a31f-49dfe300f3d3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-dc94db36-d506-4596-93d5-c928eb50e3a3 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6e24fc8d-42d5-4d11-b06b-37a4738231b0 with segmentation id not found. Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:55:20.710446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:55:20.711501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:55:20.711501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:55:20.711501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:55:20.711501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6e24fc8d-42d5-4d11-b06b-37a4738231b0 with segmentation id not found. Oct 23 00:55:20.711501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:55:21.039073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:20Z,description='Default security group',id=d626a146-c254-4675-9b51-c62ab2dec6e7,is_default=True,name='default',project_id='0f2cc661482d48e68bd662ee5a83d9b8',revision_number=1,rules=[SecurityGroupRule(241ce1d7-bb76-42cb-98a9-bc7fc8a3553a),SecurityGroupRule(24df7483-2e2a-4a87-9a28-fd8baefac08d),SecurityGroupRule(aea36b7b-d8e7-4a3e-bdbf-d0f2449d38d1),SecurityGroupRule(d1025e85-97ec-4df8-a321-edf216033322)],shared=False,stateful=True,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.039857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (d626a146-c254-4675-9b51-c62ab2dec6e7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.040328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='ingress',ethertype='IPv4',id=241ce1d7-bb76-42cb-98a9-bc7fc8a3553a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0f2cc661482d48e68bd662ee5a83d9b8',protocol=,remote_address_group_id=,remote_group_id=d626a146-c254-4675-9b51-c62ab2dec6e7,remote_ip_prefix=,revision_number=0,security_group_id=d626a146-c254-4675-9b51-c62ab2dec6e7,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.040820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (241ce1d7-bb76-42cb-98a9-bc7fc8a3553a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.041325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:21.042358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='ingress',ethertype='IPv6',id=24df7483-2e2a-4a87-9a28-fd8baefac08d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0f2cc661482d48e68bd662ee5a83d9b8',protocol=,remote_address_group_id=,remote_group_id=d626a146-c254-4675-9b51-c62ab2dec6e7,remote_ip_prefix=,revision_number=0,security_group_id=d626a146-c254-4675-9b51-c62ab2dec6e7,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.043002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (24df7483-2e2a-4a87-9a28-fd8baefac08d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.043544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:21.044393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='egress',ethertype='IPv6',id=aea36b7b-d8e7-4a3e-bdbf-d0f2449d38d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0f2cc661482d48e68bd662ee5a83d9b8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d626a146-c254-4675-9b51-c62ab2dec6e7,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.044998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (aea36b7b-d8e7-4a3e-bdbf-d0f2449d38d1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.045536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:21.046574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='egress',ethertype='IPv4',id=d1025e85-97ec-4df8-a321-edf216033322,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0f2cc661482d48e68bd662ee5a83d9b8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d626a146-c254-4675-9b51-c62ab2dec6e7,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.057386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d1025e85-97ec-4df8-a321-edf216033322), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.058600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:21.191162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:55:20Z,description='',dns_domain=None,id=2298bb57-87bf-4fb3-94ad-a41a984ccdae,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-1592472496-network',project_id='0f2cc661482d48e68bd662ee5a83d9b8',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(2298bb57-87bf-4fb3-94ad-a41a984ccdae),segments=[NetworkSegment(5388c87c-d8eb-4990-84ee-f7fbea771a74)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:55:20Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.191681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (2298bb57-87bf-4fb3-94ad-a41a984ccdae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.328302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:20Z,description='Default security group',id=b1d06491-a7a6-44ee-b7c2-32677dbd87bd,is_default=True,name='default',project_id='94cfcbd6f144492d8be27fe35cbe76d5',revision_number=1,rules=[SecurityGroupRule(693c6668-97fc-44c9-9d20-4e58432d2e15),SecurityGroupRule(7d5d27df-a5c9-46fc-89ac-7e367a22d34e),SecurityGroupRule(ad6634eb-6c85-4b66-9a0a-5562ded9d5d1),SecurityGroupRule(fb2f2c2d-ccb6-449e-9c1c-a706680256d4)],shared=False,stateful=True,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.329057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b1d06491-a7a6-44ee-b7c2-32677dbd87bd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.329917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='ingress',ethertype='IPv4',id=693c6668-97fc-44c9-9d20-4e58432d2e15,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol=,remote_address_group_id=,remote_group_id=b1d06491-a7a6-44ee-b7c2-32677dbd87bd,remote_ip_prefix=,revision_number=0,security_group_id=b1d06491-a7a6-44ee-b7c2-32677dbd87bd,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.330498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (693c6668-97fc-44c9-9d20-4e58432d2e15), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.331145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 00:55:21.331938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='ingress',ethertype='IPv6',id=7d5d27df-a5c9-46fc-89ac-7e367a22d34e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol=,remote_address_group_id=,remote_group_id=b1d06491-a7a6-44ee-b7c2-32677dbd87bd,remote_ip_prefix=,revision_number=0,security_group_id=b1d06491-a7a6-44ee-b7c2-32677dbd87bd,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.332407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7d5d27df-a5c9-46fc-89ac-7e367a22d34e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.332868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 00:55:21.333621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='egress',ethertype='IPv6',id=ad6634eb-6c85-4b66-9a0a-5562ded9d5d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b1d06491-a7a6-44ee-b7c2-32677dbd87bd,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.336545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ad6634eb-6c85-4b66-9a0a-5562ded9d5d1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.343994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 00:55:21.345263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='egress',ethertype='IPv4',id=fb2f2c2d-ccb6-449e-9c1c-a706680256d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b1d06491-a7a6-44ee-b7c2-32677dbd87bd,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.345903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fb2f2c2d-ccb6-449e-9c1c-a706680256d4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.346351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-c082ff83-3593-4db4-a4f1-ba75cee315c8 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2298bb57-87bf-4fb3-94ad-a41a984ccdae with segmentation id not found. Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:55:21.375257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:55:21.376367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:55:21.376367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:55:21.376367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:55:21.376367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2298bb57-87bf-4fb3-94ad-a41a984ccdae with segmentation id not found. Oct 23 00:55:21.376367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:55:21.507980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:55:20Z,description='',dns_domain=None,id=1d27b6d9-fef6-49cb-833f-13cb9578958e,mtu=1500,name='tempest-ServerRescueNegativeTestJSON-1310721639-network',project_id='94cfcbd6f144492d8be27fe35cbe76d5',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(1d27b6d9-fef6-49cb-833f-13cb9578958e),segments=[NetworkSegment(63b58a73-ffd1-4018-ac3c-0db314c2c768)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:55:20Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.508470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (1d27b6d9-fef6-49cb-833f-13cb9578958e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.526191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:19Z,description='Default security group',id=14f9cc16-79bc-467c-acc1-06912dbdf96d,is_default=True,name='default',project_id='59add4b78cd346a194c4be211d1996be',revision_number=1,rules=[SecurityGroupRule(46f9c9d6-9c2a-4afe-9e56-598279b4a018),SecurityGroupRule(52aace79-53fa-4e3d-aa4b-eb8cbd2b3034),SecurityGroupRule(65f7331b-050b-40ac-9eb2-6f8b75dc3c95),SecurityGroupRule(fb3b4529-77bb-4ee5-bb8e-3ae581ddc7d5)],shared=False,stateful=True,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.527044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (14f9cc16-79bc-467c-acc1-06912dbdf96d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.527839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='egress',ethertype='IPv6',id=46f9c9d6-9c2a-4afe-9e56-598279b4a018,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=14f9cc16-79bc-467c-acc1-06912dbdf96d,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.528350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (46f9c9d6-9c2a-4afe-9e56-598279b4a018), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.529038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 00:55:21.530056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='ingress',ethertype='IPv4',id=52aace79-53fa-4e3d-aa4b-eb8cbd2b3034,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=14f9cc16-79bc-467c-acc1-06912dbdf96d,remote_ip_prefix=,revision_number=0,security_group_id=14f9cc16-79bc-467c-acc1-06912dbdf96d,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.530570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (52aace79-53fa-4e3d-aa4b-eb8cbd2b3034), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.531166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 00:55:21.532030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='ingress',ethertype='IPv6',id=65f7331b-050b-40ac-9eb2-6f8b75dc3c95,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=14f9cc16-79bc-467c-acc1-06912dbdf96d,remote_ip_prefix=,revision_number=0,security_group_id=14f9cc16-79bc-467c-acc1-06912dbdf96d,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.532544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (65f7331b-050b-40ac-9eb2-6f8b75dc3c95), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.533053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 00:55:21.536041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:20Z,description=,direction='egress',ethertype='IPv4',id=fb3b4529-77bb-4ee5-bb8e-3ae581ddc7d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=14f9cc16-79bc-467c-acc1-06912dbdf96d,updated_at=2022-10-23T00:55:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.536407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fb3b4529-77bb-4ee5-bb8e-3ae581ddc7d5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.536752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 00:55:21.745267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:55:20Z,description='',dns_domain=None,id=f8105e98-346f-4369-be4d-2cb2d399c07a,mtu=1500,name='tempest-AttachVolumeShelveTestJSON-758508699-network',project_id='59add4b78cd346a194c4be211d1996be',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(f8105e98-346f-4369-be4d-2cb2d399c07a),segments=[NetworkSegment(7dc83201-cb39-4cd2-9302-c1b785eda914)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:55:21Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:21.745908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (f8105e98-346f-4369-be4d-2cb2d399c07a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.828237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:238 started Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-19778d60-41e7-46c3-8c15-78d468f6903e admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1d27b6d9-fef6-49cb-833f-13cb9578958e with segmentation id not found. Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:55:21.831001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:55:21.832865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:55:21.832865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:55:21.832865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:55:21.832865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1d27b6d9-fef6-49cb-833f-13cb9578958e with segmentation id not found. Oct 23 00:55:21.832865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:55:21.835028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=905000000,duration_sec=482,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:21.835983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:21.836595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:238 - starting polling. Elapsed:0.009 Oct 23 00:55:21.838803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:21.842539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:238 - port information retrieved. Elapsed:0.015 Oct 23 00:55:21.842875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 'added': {'81a4888a-a035-4442-91ea-dd123a7c1c39'}, 'removed': set(), 'updated': {'81a4888a-a035-4442-91ea-dd123a7c1c39'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:21.843603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-af018619-0331-4553-bdbc-b12c91da85cf', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'mac_address': 'fa:16:3e:b6:cd:c7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:21.854302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 81a4888a-a035-4442-91ea-dd123a7c1c39 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:21.857455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 81a4888a-a035-4442-91ea-dd123a7c1c39 updated. Details: {'device': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-af018619-0331-4553-bdbc-b12c91da85cf', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'mac_address': 'fa:16:3e:b6:cd:c7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:55:21.857805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 4 as local vlan for net-id=af018619-0331-4553-bdbc-b12c91da85cf, seg-id=354 Oct 23 00:55:21.904252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1321192d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4450), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:21.917068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2a3e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4100)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4450}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:21.919142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap81a4888a-a0, col_values=(('tag', 4),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:21.919595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap81a4888a-a0, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:21.924536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap81a4888a-a0, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:21.943669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap81a4888a-a0, col_values=(('other_config', {'net_uuid': 'af018619-0331-4553-bdbc-b12c91da85cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '354'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:21.962839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a40,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:21.969975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:238 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.120 Oct 23 00:55:21.970402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:55:21.970712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'81a4888a-a035-4442-91ea-dd123a7c1c39'} Oct 23 00:55:21.972003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:21.972293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:21.984265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:22.091190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[4537528a-968b-4c21-8d44-9c6fe74aa31f]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:22.091958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:238 - agent port security group processed in 0.249 Oct 23 00:55:22.092527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 81a4888a-a035-4442-91ea-dd123a7c1c39 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-2380fd3c-b38e-4e9f-b548-1258d7ea3d32 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f8105e98-346f-4369-be4d-2cb2d399c07a with segmentation id not found. Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:55:22.226480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:55:22.227482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:55:22.227482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:55:22.227482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:55:22.227482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f8105e98-346f-4369-be4d-2cb2d399c07a with segmentation id not found. Oct 23 00:55:22.227482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:55:22.250865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-df1e32aa-6fbd-45fd-8760-12f1991ef5f7 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ef1ced35-f36c-444c-9ac8-3998906bdab5)],cidr=172.20.0.0/28,created_at=2022-10-23T00:55:21Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=e8caf190-1929-4d28-927b-ec9b345ce0f1,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-1592472496-subnet',network_id=2298bb57-87bf-4fb3-94ad-a41a984ccdae,project_id='0f2cc661482d48e68bd662ee5a83d9b8',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:55:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.251607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-df1e32aa-6fbd-45fd-8760-12f1991ef5f7 admin admin] Publish callbacks [] for Subnet (e8caf190-1929-4d28-927b-ec9b345ce0f1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.525586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-52204e9d-2013-4e45-9fad-0077783b1f07 None None] Resource Port 81a4888a-a035-4442-91ea-dd123a7c1c39 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:22.525968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-52204e9d-2013-4e45-9fad-0077783b1f07 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (81a4888a-a035-4442-91ea-dd123a7c1c39), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.559043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['81a4888a-a035-4442-91ea-dd123a7c1c39'] and devices down [] completed. Oct 23 00:55:22.559405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:238 - ports processed. Elapsed:0.731 Oct 23 00:55:22.559744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:238 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.732 Oct 23 00:55:22.689743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-96092535-7e6a-4081-a4b5-ff195a871a7e admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(dd7664f4-a39f-4bf1-9fad-9acf293fa032)],cidr=172.20.0.0/28,created_at=2022-10-23T00:55:22Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=b567fc0e-81bb-4e4e-8bd3-a17fd2562f11,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-ServerRescueNegativeTestJSON-1310721639-subnet',network_id=1d27b6d9-fef6-49cb-833f-13cb9578958e,project_id='94cfcbd6f144492d8be27fe35cbe76d5',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.690552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-96092535-7e6a-4081-a4b5-ff195a871a7e admin admin] Publish callbacks [] for Subnet (b567fc0e-81bb-4e4e-8bd3-a17fd2562f11), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.751493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a03f3595-bb79-4e82-b347-e086a2b53508 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ba68e339-7c55-4ab3-8951-a8659f1cf353)],cidr=172.20.0.0/28,created_at=2022-10-23T00:55:22Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=52944cd4-669b-4a10-a076-1661bc94a4a7,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeShelveTestJSON-758508699-subnet',network_id=f8105e98-346f-4369-be4d-2cb2d399c07a,project_id='59add4b78cd346a194c4be211d1996be',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.752645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a03f3595-bb79-4e82-b347-e086a2b53508 admin admin] Publish callbacks [] for Subnet (52944cd4-669b-4a10-a076-1661bc94a4a7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.821303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-53457697-ea4d-463d-b214-daae77becc4b admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(01a5248b-825c-4de4-bd01-813aaa68efe2)],cidr=172.20.0.0/28,created_at=2022-10-23T00:55:21Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=bdebfcdc-6951-4fee-aa37-29ecb806813d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeTestJSON-363803032-subnet',network_id=6e24fc8d-42d5-4d11-b06b-37a4738231b0,project_id='2a9697845193443ea394c1b480b6b769',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:55:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.822001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-53457697-ea4d-463d-b214-daae77becc4b admin admin] Publish callbacks [] for Subnet (bdebfcdc-6951-4fee-aa37-29ecb806813d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.980216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:22Z,description='Default security group',id=fe70ee00-75ad-4ba1-98e7-043de7aeeb8e,is_default=True,name='default',project_id='980b6286de764da58dfe1a976b38c8e3',revision_number=1,rules=[SecurityGroupRule(4a2f34e7-6cf9-4b06-8b19-1834ae46a76c),SecurityGroupRule(546d7102-d91c-45f0-bff5-3cc96c9fd45e),SecurityGroupRule(9f37beb5-46ac-438d-9929-4057ba615750),SecurityGroupRule(f24eb7a1-11d6-4340-a376-b3302364ab34)],shared=False,stateful=True,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.980818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (fe70ee00-75ad-4ba1-98e7-043de7aeeb8e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.981713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='ingress',ethertype='IPv6',id=4a2f34e7-6cf9-4b06-8b19-1834ae46a76c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='980b6286de764da58dfe1a976b38c8e3',protocol=,remote_address_group_id=,remote_group_id=fe70ee00-75ad-4ba1-98e7-043de7aeeb8e,remote_ip_prefix=,revision_number=0,security_group_id=fe70ee00-75ad-4ba1-98e7-043de7aeeb8e,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.982276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4a2f34e7-6cf9-4b06-8b19-1834ae46a76c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.983154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:22.984830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='ingress',ethertype='IPv4',id=546d7102-d91c-45f0-bff5-3cc96c9fd45e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='980b6286de764da58dfe1a976b38c8e3',protocol=,remote_address_group_id=,remote_group_id=fe70ee00-75ad-4ba1-98e7-043de7aeeb8e,remote_ip_prefix=,revision_number=0,security_group_id=fe70ee00-75ad-4ba1-98e7-043de7aeeb8e,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.985744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (546d7102-d91c-45f0-bff5-3cc96c9fd45e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.986485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:22.987308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='egress',ethertype='IPv6',id=9f37beb5-46ac-438d-9929-4057ba615750,normalized_cidr=None,port_range_max=,port_range_min=,project_id='980b6286de764da58dfe1a976b38c8e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe70ee00-75ad-4ba1-98e7-043de7aeeb8e,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.990680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9f37beb5-46ac-438d-9929-4057ba615750), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.991350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:22.992452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='egress',ethertype='IPv4',id=f24eb7a1-11d6-4340-a376-b3302364ab34,normalized_cidr=None,port_range_max=,port_range_min=,project_id='980b6286de764da58dfe1a976b38c8e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe70ee00-75ad-4ba1-98e7-043de7aeeb8e,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:22.993009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f24eb7a1-11d6-4340-a376-b3302364ab34), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:22.994118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ed005ddf-8a01-418a-bf17-8360f673afd4 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:23.168934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:22Z,description='Default security group',id=ee0b414b-c662-4ef7-91ff-369f3a2c80a3,is_default=True,name='default',project_id='eee05015c95045ef8824ab825f6963c9',revision_number=1,rules=[SecurityGroupRule(36e472ba-d224-4bd7-8e2f-044b9a212c69),SecurityGroupRule(37344d20-3e15-4cc5-8a60-b810fd66eec3),SecurityGroupRule(68ee61de-1493-41d0-8fbd-c7f71e9320cf),SecurityGroupRule(a743306c-3568-49e9-a30a-5e45028d0103)],shared=False,stateful=True,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:23.169697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (ee0b414b-c662-4ef7-91ff-369f3a2c80a3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.170733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='ingress',ethertype='IPv6',id=36e472ba-d224-4bd7-8e2f-044b9a212c69,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eee05015c95045ef8824ab825f6963c9',protocol=,remote_address_group_id=,remote_group_id=ee0b414b-c662-4ef7-91ff-369f3a2c80a3,remote_ip_prefix=,revision_number=0,security_group_id=ee0b414b-c662-4ef7-91ff-369f3a2c80a3,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:23.171515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (36e472ba-d224-4bd7-8e2f-044b9a212c69), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.171874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.172584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='ingress',ethertype='IPv4',id=37344d20-3e15-4cc5-8a60-b810fd66eec3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eee05015c95045ef8824ab825f6963c9',protocol=,remote_address_group_id=,remote_group_id=ee0b414b-c662-4ef7-91ff-369f3a2c80a3,remote_ip_prefix=,revision_number=0,security_group_id=ee0b414b-c662-4ef7-91ff-369f3a2c80a3,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:23.172986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (37344d20-3e15-4cc5-8a60-b810fd66eec3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.173319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.173991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='egress',ethertype='IPv4',id=68ee61de-1493-41d0-8fbd-c7f71e9320cf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eee05015c95045ef8824ab825f6963c9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ee0b414b-c662-4ef7-91ff-369f3a2c80a3,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:23.174344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (68ee61de-1493-41d0-8fbd-c7f71e9320cf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.179253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.180282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:22Z,description=,direction='egress',ethertype='IPv6',id=a743306c-3568-49e9-a30a-5e45028d0103,normalized_cidr=None,port_range_max=,port_range_min=,project_id='eee05015c95045ef8824ab825f6963c9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ee0b414b-c662-4ef7-91ff-369f3a2c80a3,updated_at=2022-10-23T00:55:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:23.180658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a743306c-3568-49e9-a30a-5e45028d0103), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.181022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0320f5aa-72b3-413f-be44-742b1c6df7d1 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.510719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Resource SecurityGroup deleted: ee0b414b-c662-4ef7-91ff-369f3a2c80a3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:23.511914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (ee0b414b-c662-4ef7-91ff-369f3a2c80a3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.512399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ee0b414b-c662-4ef7-91ff-369f3a2c80a3',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:23.829457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:239 started Oct 23 00:55:23.833175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=903000000,duration_sec=484,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:23.834055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:23.834406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:239 - starting polling. Elapsed:0.005 Oct 23 00:55:23.835838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.845876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:239 - port information retrieved. Elapsed:0.015 Oct 23 00:55:23.846613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 'added': set(), 'removed': set(), 'updated': {'81a4888a-a035-4442-91ea-dd123a7c1c39'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:23.849247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-af018619-0331-4553-bdbc-b12c91da85cf', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'mac_address': 'fa:16:3e:b6:cd:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:23.852911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 81a4888a-a035-4442-91ea-dd123a7c1c39 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:23.854659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 81a4888a-a035-4442-91ea-dd123a7c1c39 updated. Details: {'device': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-af018619-0331-4553-bdbc-b12c91da85cf', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '81a4888a-a035-4442-91ea-dd123a7c1c39', 'mac_address': 'fa:16:3e:b6:cd:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 23 00:55:23.857959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap81a4888a-a0, col_values=(('tag', 4),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:23.860899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap81a4888a-a0, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:23.862264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap81a4888a-a0, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:23.864586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:23.866980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap81a4888a-a0, col_values=(('other_config', {'net_uuid': 'af018619-0331-4553-bdbc-b12c91da85cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '354', 'tag': '4'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:23.871078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:23.878702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ee0b414b-c662-4ef7-91ff-369f3a2c80a3',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:23.879872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Resource SecurityGroupRule deleted: 36e472ba-d224-4bd7-8e2f-044b9a212c69 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:23.881462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (36e472ba-d224-4bd7-8e2f-044b9a212c69), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.882472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.884403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Resource SecurityGroupRule deleted: 37344d20-3e15-4cc5-8a60-b810fd66eec3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:23.885912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (37344d20-3e15-4cc5-8a60-b810fd66eec3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.886423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.888942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Resource SecurityGroupRule deleted: 68ee61de-1493-41d0-8fbd-c7f71e9320cf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:23.892408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (68ee61de-1493-41d0-8fbd-c7f71e9320cf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.893179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.894109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Resource SecurityGroupRule deleted: a743306c-3568-49e9-a30a-5e45028d0103 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:23.895070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a743306c-3568-49e9-a30a-5e45028d0103), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:23.895622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f688b25d-18b0-45fd-a4df-eee7c6b2a643 admin admin] Security group rule updated ['ee0b414b-c662-4ef7-91ff-369f3a2c80a3'] Oct 23 00:55:23.899114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a44,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:23.901918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:239 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.054 Oct 23 00:55:23.902515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:23.903006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:23.905351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:23.907534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:23.917673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:24.052198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b04d7-5835-4d35-afe5-ad2e4fba301e]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:24.053026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:239 - agent port security group processed in 0.204 Oct 23 00:55:24.053531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 81a4888a-a035-4442-91ea-dd123a7c1c39 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:24.781429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6c916d7b-0ee5-4da4-81cf-7cc81aa67bce None None] Resource Port cfbaf355-dc65-4e70-a31f-49dfe300f3d3 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:24.783068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6c916d7b-0ee5-4da4-81cf-7cc81aa67bce None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cfbaf355-dc65-4e70-a31f-49dfe300f3d3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:24.879612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Resource SecurityGroup deleted: fe70ee00-75ad-4ba1-98e7-043de7aeeb8e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:24.880301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (fe70ee00-75ad-4ba1-98e7-043de7aeeb8e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:24.881222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fe70ee00-75ad-4ba1-98e7-043de7aeeb8e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:25.238212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:24Z,description='Default security group',id=2174eca8-40a2-4e04-af07-b35f82cfb2d3,is_default=True,name='default',project_id='52f36de98c1948ceb410e578273660f5',revision_number=1,rules=[SecurityGroupRule(487cc0e7-6f23-4a0f-98e2-acc50547e6a7),SecurityGroupRule(7d49f29f-3666-4537-b3ac-ec9a81d56d9f),SecurityGroupRule(ad03e885-17c6-4fc5-814c-233a8462c194),SecurityGroupRule(ce36aa81-56c0-4aec-b0fb-bd3a0192f2af)],shared=False,stateful=True,updated_at=2022-10-23T00:55:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.239451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (2174eca8-40a2-4e04-af07-b35f82cfb2d3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.241550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:24Z,description=,direction='ingress',ethertype='IPv6',id=487cc0e7-6f23-4a0f-98e2-acc50547e6a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f36de98c1948ceb410e578273660f5',protocol=,remote_address_group_id=,remote_group_id=2174eca8-40a2-4e04-af07-b35f82cfb2d3,remote_ip_prefix=,revision_number=0,security_group_id=2174eca8-40a2-4e04-af07-b35f82cfb2d3,updated_at=2022-10-23T00:55:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.242599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (487cc0e7-6f23-4a0f-98e2-acc50547e6a7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.243362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:25.244450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:24Z,description=,direction='egress',ethertype='IPv4',id=7d49f29f-3666-4537-b3ac-ec9a81d56d9f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f36de98c1948ceb410e578273660f5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2174eca8-40a2-4e04-af07-b35f82cfb2d3,updated_at=2022-10-23T00:55:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.245043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7d49f29f-3666-4537-b3ac-ec9a81d56d9f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.245607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:25.246530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:24Z,description=,direction='ingress',ethertype='IPv4',id=ad03e885-17c6-4fc5-814c-233a8462c194,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f36de98c1948ceb410e578273660f5',protocol=,remote_address_group_id=,remote_group_id=2174eca8-40a2-4e04-af07-b35f82cfb2d3,remote_ip_prefix=,revision_number=0,security_group_id=2174eca8-40a2-4e04-af07-b35f82cfb2d3,updated_at=2022-10-23T00:55:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.247282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ad03e885-17c6-4fc5-814c-233a8462c194), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.248581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:25.250543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:24Z,description=,direction='egress',ethertype='IPv6',id=ce36aa81-56c0-4aec-b0fb-bd3a0192f2af,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52f36de98c1948ceb410e578273660f5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2174eca8-40a2-4e04-af07-b35f82cfb2d3,updated_at=2022-10-23T00:55:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.251929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ce36aa81-56c0-4aec-b0fb-bd3a0192f2af), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.252420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:25.270177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6c916d7b-0ee5-4da4-81cf-7cc81aa67bce None None] Resource Port cfbaf355-dc65-4e70-a31f-49dfe300f3d3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:25.271072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6c916d7b-0ee5-4da4-81cf-7cc81aa67bce None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cfbaf355-dc65-4e70-a31f-49dfe300f3d3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.506726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['81a4888a-a035-4442-91ea-dd123a7c1c39'] and devices down [] completed. Oct 23 00:55:25.507230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:239 - ports processed. Elapsed:1.678 Oct 23 00:55:25.507823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:239 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.678 Oct 23 00:55:25.552064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16ebd158-8a94-4d4a-a726-46dd0efa05c6 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:23Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1d27b6d9-fef6-49cb-833f-13cb9578958e',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2d687c63-2eda-4404-94d4-512d1659dd28,mac_address=fa:16:3e:4f:02:78,name='',network_id=1d27b6d9-fef6-49cb-833f-13cb9578958e,numa_affinity_policy=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2d687c63-2eda-4404-94d4-512d1659dd28),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.553346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16ebd158-8a94-4d4a-a726-46dd0efa05c6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2d687c63-2eda-4404-94d4-512d1659dd28), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.573821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-928375c9-755d-443f-b099-c32890ab02b6 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:24Z,data_plane_status=None,description='',device_id='fdd0b971-41e7-4c06-aca2-3799f3e76e98',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,mac_address=fa:16:3e:7a:80:7c,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e10e1214-c988-4645-bc00-e42d4d9a7e6b),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.574507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-928375c9-755d-443f-b099-c32890ab02b6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e10e1214-c988-4645-bc00-e42d4d9a7e6b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.589487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fe70ee00-75ad-4ba1-98e7-043de7aeeb8e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:25.590197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Resource SecurityGroupRule deleted: 4a2f34e7-6cf9-4b06-8b19-1834ae46a76c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:25.590829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4a2f34e7-6cf9-4b06-8b19-1834ae46a76c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.591353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:25.591897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Resource SecurityGroupRule deleted: 546d7102-d91c-45f0-bff5-3cc96c9fd45e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:25.592541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (546d7102-d91c-45f0-bff5-3cc96c9fd45e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.593154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:25.593709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Resource SecurityGroupRule deleted: 9f37beb5-46ac-438d-9929-4057ba615750 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:25.594485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9f37beb5-46ac-438d-9929-4057ba615750), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.594973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:25.595493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Resource SecurityGroupRule deleted: f24eb7a1-11d6-4340-a376-b3302364ab34 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:25.595982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f24eb7a1-11d6-4340-a376-b3302364ab34), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.596461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c0d3e407-d532-4dd1-a9a4-85b4b8f041a6 admin admin] Security group rule updated ['fe70ee00-75ad-4ba1-98e7-043de7aeeb8e'] Oct 23 00:55:25.737592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:55:24Z,description='',dns_domain=None,id=b1925aa5-5761-41a7-815b-1f0974e3c32c,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-338684226-network',project_id='52f36de98c1948ceb410e578273660f5',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(b1925aa5-5761-41a7-815b-1f0974e3c32c),segments=[NetworkSegment(e943d62d-0c42-4d97-95fc-909991a42af4)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:55:24Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:25.738492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (b1925aa5-5761-41a7-815b-1f0974e3c32c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.830410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:240 started Oct 23 00:55:25.841085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=905000000,duration_sec=486,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:25.841705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:25.842266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:240 - starting polling. Elapsed:0.012 Oct 23 00:55:25.844524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:25.847057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:240 - port information retrieved. Elapsed:0.017 Oct 23 00:55:25.847612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:240 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-9f9fb68f-55df-46f4-befe-fab8af1b2a53 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b1925aa5-5761-41a7-815b-1f0974e3c32c with segmentation id not found. Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:55:26.044870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:55:26.045797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:55:26.045797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:55:26.045797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:55:26.045797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b1925aa5-5761-41a7-815b-1f0974e3c32c with segmentation id not found. Oct 23 00:55:26.045797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:55:26.138103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa8a8b2a-251a-4c96-a208-fadcc3751dd9","insert","qg-cfbaf355-dc",["set",[]],["map",[["attached-mac","fa:16:3e:6d:af:6d"],["iface-id","cfbaf355-dc65-4e70-a31f-49dfe300f3d3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:26.155922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6797d6d-e43a-4c19-b68f-f9de548ff5a3 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:23Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6e24fc8d-42d5-4d11-b06b-37a4738231b0',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fe0c83f1-a5c5-47bb-a91f-c709bd53e220,mac_address=fa:16:3e:35:08:26,name='',network_id=6e24fc8d-42d5-4d11-b06b-37a4738231b0,numa_affinity_policy=,project_id='2a9697845193443ea394c1b480b6b769',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fe0c83f1-a5c5-47bb-a91f-c709bd53e220),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.165246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6797d6d-e43a-4c19-b68f-f9de548ff5a3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fe0c83f1-a5c5-47bb-a91f-c709bd53e220), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.166469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa8a8b2a-251a-4c96-a208-fadcc3751dd9","old",null,["set",[]],null],["","new","qg-cfbaf355-dc",7,["map",[["attached-mac","fa:16:3e:6d:af:6d"],["iface-id","cfbaf355-dc65-4e70-a31f-49dfe300f3d3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:26.256278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c93a1ba-17a4-4e80-b4db-0087dc94109d None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:24Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f8105e98-346f-4369-be4d-2cb2d399c07a',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=02ea638b-e76a-43d4-a7af-3b5be374e752,mac_address=fa:16:3e:c6:9d:7d,name='',network_id=f8105e98-346f-4369-be4d-2cb2d399c07a,numa_affinity_policy=,project_id='59add4b78cd346a194c4be211d1996be',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(02ea638b-e76a-43d4-a7af-3b5be374e752),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.266718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c93a1ba-17a4-4e80-b4db-0087dc94109d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (02ea638b-e76a-43d4-a7af-3b5be374e752), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.579739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bd73529f-3d21-447f-aa8b-2533cdebe197 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:25Z,data_plane_status=None,description='',device_id='2c238434-bfef-4fde-aac0-cae3ae6aa742',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1af047de-df31-40f1-8ab4-6afa1a4ee2ae,mac_address=fa:16:3e:89:e0:2c,name='',network_id=af018619-0331-4553-bdbc-b12c91da85cf,numa_affinity_policy=,project_id='29c3589cf3024c1083bc90f33ab61c00',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1af047de-df31-40f1-8ab4-6afa1a4ee2ae),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.581664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bd73529f-3d21-447f-aa8b-2533cdebe197 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (1af047de-df31-40f1-8ab4-6afa1a4ee2ae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.655366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:25Z,description='Default security group',id=e7163c69-1289-4763-b6ee-cd204a523d54,is_default=True,name='default',project_id='39abd517c140428ab567f4efa5d249b2',revision_number=1,rules=[SecurityGroupRule(46aa3fef-bf68-47fa-b055-d50c93c53f38),SecurityGroupRule(9cb5e485-0748-44a7-aa66-ad41d6765fcd),SecurityGroupRule(da0764d2-b306-4984-9067-ef970fcc7cf3),SecurityGroupRule(e9d6b378-0df9-4b75-839e-fa623e747fbf)],shared=False,stateful=True,updated_at=2022-10-23T00:55:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.656949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (e7163c69-1289-4763-b6ee-cd204a523d54), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.659019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:26Z,description=,direction='egress',ethertype='IPv6',id=46aa3fef-bf68-47fa-b055-d50c93c53f38,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39abd517c140428ab567f4efa5d249b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e7163c69-1289-4763-b6ee-cd204a523d54,updated_at=2022-10-23T00:55:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.659731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (46aa3fef-bf68-47fa-b055-d50c93c53f38), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.660224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:26.661394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:26Z,description=,direction='ingress',ethertype='IPv4',id=9cb5e485-0748-44a7-aa66-ad41d6765fcd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39abd517c140428ab567f4efa5d249b2',protocol=,remote_address_group_id=,remote_group_id=e7163c69-1289-4763-b6ee-cd204a523d54,remote_ip_prefix=,revision_number=0,security_group_id=e7163c69-1289-4763-b6ee-cd204a523d54,updated_at=2022-10-23T00:55:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.662598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9cb5e485-0748-44a7-aa66-ad41d6765fcd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.663121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:26.664325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:26Z,description=,direction='egress',ethertype='IPv4',id=da0764d2-b306-4984-9067-ef970fcc7cf3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39abd517c140428ab567f4efa5d249b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e7163c69-1289-4763-b6ee-cd204a523d54,updated_at=2022-10-23T00:55:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.670407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (da0764d2-b306-4984-9067-ef970fcc7cf3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.670756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:26.671714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:26Z,description=,direction='ingress',ethertype='IPv6',id=e9d6b378-0df9-4b75-839e-fa623e747fbf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39abd517c140428ab567f4efa5d249b2',protocol=,remote_address_group_id=,remote_group_id=e7163c69-1289-4763-b6ee-cd204a523d54,remote_ip_prefix=,revision_number=0,security_group_id=e7163c69-1289-4763-b6ee-cd204a523d54,updated_at=2022-10-23T00:55:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.695043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e9d6b378-0df9-4b75-839e-fa623e747fbf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.695552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b97844e1-a101-4690-8c3c-2f384ee7247d admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:26.709911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16ebd158-8a94-4d4a-a726-46dd0efa05c6 None None] Resource Port 2d687c63-2eda-4404-94d4-512d1659dd28 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2d687c63-2eda-4404-94d4-512d1659dd28,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2d687c63-2eda-4404-94d4-512d1659dd28,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2d687c63-2eda-4404-94d4-512d1659dd28,segment=NetworkSegment(63b58a73-ffd1-4018-ac3c-0db314c2c768),segment_id=63b58a73-ffd1-4018-ac3c-0db314c2c768)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:26.714996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16ebd158-8a94-4d4a-a726-46dd0efa05c6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2d687c63-2eda-4404-94d4-512d1659dd28), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:26.790226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["069cbcf8-f23e-4f81-b93c-c5b36a47a09b","insert","tap2d687c63-2e",["set",[]],["map",[["attached-mac","fa:16:3e:4f:02:78"],["iface-id","2d687c63-2eda-4404-94d4-512d1659dd28"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:26.817046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["069cbcf8-f23e-4f81-b93c-c5b36a47a09b","old",null,["set",[]],null],["","new","tap2d687c63-2e",8,["map",[["attached-mac","fa:16:3e:4f:02:78"],["iface-id","2d687c63-2eda-4404-94d4-512d1659dd28"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:26.925718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a324cba9-dde1-4c81-bac7-bd91b92045a7 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:25Z,data_plane_status=None,description='',device_id='2d77609f-f6a2-4b66-94b2-dbd18b570cb6',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f0e20492-cd09-472c-ad67-7a194ee39b4a,mac_address=fa:16:3e:c5:d9:ea,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f0e20492-cd09-472c-ad67-7a194ee39b4a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:26.926308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a324cba9-dde1-4c81-bac7-bd91b92045a7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f0e20492-cd09-472c-ad67-7a194ee39b4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:27.190223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6797d6d-e43a-4c19-b68f-f9de548ff5a3 None None] Resource Port fe0c83f1-a5c5-47bb-a91f-c709bd53e220 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fe0c83f1-a5c5-47bb-a91f-c709bd53e220,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fe0c83f1-a5c5-47bb-a91f-c709bd53e220,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fe0c83f1-a5c5-47bb-a91f-c709bd53e220,segment=NetworkSegment(6c7f3988-5c29-4b49-bf43-a45d839e2e81),segment_id=6c7f3988-5c29-4b49-bf43-a45d839e2e81)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:27.190611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6797d6d-e43a-4c19-b68f-f9de548ff5a3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fe0c83f1-a5c5-47bb-a91f-c709bd53e220), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:27.396573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e7068922-2640-40b6-a5b2-5404090503ed admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(c8dbe983-4c2f-453c-96eb-73d30658d28a)],cidr=172.20.0.0/28,created_at=2022-10-23T00:55:26Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=fac20a69-0883-4ad5-8616-bfb98513cb28,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-338684226-subnet',network_id=b1925aa5-5761-41a7-815b-1f0974e3c32c,project_id='52f36de98c1948ceb410e578273660f5',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:55:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:27.397178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e7068922-2640-40b6-a5b2-5404090503ed admin admin] Publish callbacks [] for Subnet (fac20a69-0883-4ad5-8616-bfb98513cb28), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:27.415289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c93a1ba-17a4-4e80-b4db-0087dc94109d None None] Resource Port 02ea638b-e76a-43d4-a7af-3b5be374e752 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=02ea638b-e76a-43d4-a7af-3b5be374e752,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=02ea638b-e76a-43d4-a7af-3b5be374e752,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=02ea638b-e76a-43d4-a7af-3b5be374e752,segment=NetworkSegment(7dc83201-cb39-4cd2-9302-c1b785eda914),segment_id=7dc83201-cb39-4cd2-9302-c1b785eda914)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:27.421385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c93a1ba-17a4-4e80-b4db-0087dc94109d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (02ea638b-e76a-43d4-a7af-3b5be374e752), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:27.429401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["70a97d35-69da-4b55-9073-557c9eedbfb6","insert","tapfe0c83f1-a5",["set",[]],["map",[["attached-mac","fa:16:3e:35:08:26"],["iface-id","fe0c83f1-a5c5-47bb-a91f-c709bd53e220"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:27.474332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["70a97d35-69da-4b55-9073-557c9eedbfb6","old",null,["set",[]],null],["","new","tapfe0c83f1-a5",9,["map",[["attached-mac","fa:16:3e:35:08:26"],["iface-id","fe0c83f1-a5c5-47bb-a91f-c709bd53e220"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:27.580159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f48e7b47-b79a-4bfe-ac5a-8010d02b6f2d","insert","tap02ea638b-e7",["set",[]],["map",[["attached-mac","fa:16:3e:c6:9d:7d"],["iface-id","02ea638b-e76a-43d4-a7af-3b5be374e752"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:27.594660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f48e7b47-b79a-4bfe-ac5a-8010d02b6f2d","old",null,["set",[]],null],["","new","tap02ea638b-e7",10,["map",[["attached-mac","fa:16:3e:c6:9d:7d"],["iface-id","02ea638b-e76a-43d4-a7af-3b5be374e752"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:27.834794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:241 started Oct 23 00:55:27.845282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=914000000,duration_sec=488,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:27.846057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:27.846809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:241 - starting polling. Elapsed:0.012 Oct 23 00:55:27.850022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:27.852106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:241 - port information retrieved. Elapsed:0.017 Oct 23 00:55:27.852439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39'}, 'added': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '2d687c63-2eda-4404-94d4-512d1659dd28', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3'}, 'removed': set(), 'updated': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '2d687c63-2eda-4404-94d4-512d1659dd28', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:27.866398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'mac_address': 'fa:16:3e:c6:9d:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:27.867003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'mac_address': 'fa:16:3e:6d:af:6d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.240'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:27.867480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '2d687c63-2eda-4404-94d4-512d1659dd28', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': '2d687c63-2eda-4404-94d4-512d1659dd28', 'mac_address': 'fa:16:3e:4f:02:78', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:27.868013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'mac_address': 'fa:16:3e:35:08:26', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:27.881628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 02ea638b-e76a-43d4-a7af-3b5be374e752 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:27.881998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 02ea638b-e76a-43d4-a7af-3b5be374e752 updated. Details: {'device': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'mac_address': 'fa:16:3e:c6:9d:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:55:27.882345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 5 as local vlan for net-id=f8105e98-346f-4369-be4d-2cb2d399c07a, seg-id=356 Oct 23 00:55:27.884738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Resource SecurityGroup deleted: e7163c69-1289-4763-b6ee-cd204a523d54 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:27.900743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (e7163c69-1289-4763-b6ee-cd204a523d54), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:27.901047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e7163c69-1289-4763-b6ee-cd204a523d54',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:27.921926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1321192f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4452), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:27.928680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2a4a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4101)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4452}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:27.950763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap02ea638b-e7, col_values=(('tag', 5),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:27.951215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap02ea638b-e7, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:27.951659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap02ea638b-e7, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:27.972566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap02ea638b-e7, col_values=(('other_config', {'net_uuid': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '356'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:27.988126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a4c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:27.988784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: cfbaf355-dc65-4e70-a31f-49dfe300f3d3 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:27.989448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port cfbaf355-dc65-4e70-a31f-49dfe300f3d3 updated. Details: {'device': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'mac_address': 'fa:16:3e:6d:af:6d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.240'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:27.990699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-cfbaf355-dc, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:27.991300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-cfbaf355-dc, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:27.991975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-cfbaf355-dc, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.004926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-cfbaf355-dc, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.021769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a4e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:28.022371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 2d687c63-2eda-4404-94d4-512d1659dd28 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:28.022895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2d687c63-2eda-4404-94d4-512d1659dd28 updated. Details: {'device': '2d687c63-2eda-4404-94d4-512d1659dd28', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': '2d687c63-2eda-4404-94d4-512d1659dd28', 'mac_address': 'fa:16:3e:4f:02:78', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:55:28.023464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 6 as local vlan for net-id=1d27b6d9-fef6-49cb-833f-13cb9578958e, seg-id=366 Oct 23 00:55:28.039585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211931,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4462), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:28.043838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2a50,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4102)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4462}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:28.046065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d687c63-2e, col_values=(('tag', 6),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.048284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap2d687c63-2e, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.048937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap2d687c63-2e, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.063069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d687c63-2e, col_values=(('other_config', {'net_uuid': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '366'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.078897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a52,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:28.079250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: fe0c83f1-a5c5-47bb-a91f-c709bd53e220 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:28.079659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port fe0c83f1-a5c5-47bb-a91f-c709bd53e220 updated. Details: {'device': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'mac_address': 'fa:16:3e:35:08:26', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:55:28.080185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 7 as local vlan for net-id=6e24fc8d-42d5-4d11-b06b-37a4738231b0, seg-id=399 Oct 23 00:55:28.107975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211933,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4495), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:28.125856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2a54,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4103)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4495}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:28.130642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe0c83f1-a5, col_values=(('tag', 7),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.131490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfe0c83f1-a5, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.132149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfe0c83f1-a5, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.151226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe0c83f1-a5, col_values=(('other_config', {'net_uuid': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '399'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:28.171371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a56,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:28.173524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:241 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.320 Oct 23 00:55:28.175608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 4 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:55:28.176851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'02ea638b-e76a-43d4-a7af-3b5be374e752', '2d687c63-2eda-4404-94d4-512d1659dd28', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3'} Oct 23 00:55:28.192836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:28.193460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:28.205539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:28.241841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e7163c69-1289-4763-b6ee-cd204a523d54',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:28.243146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Resource SecurityGroupRule deleted: 46aa3fef-bf68-47fa-b055-d50c93c53f38 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:28.255365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (46aa3fef-bf68-47fa-b055-d50c93c53f38), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:28.257181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:28.342027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b96c15d-57ec-47d1-9b46-6670869a9ece]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:28.343246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:241 - agent port security group processed in 0.490 Oct 23 00:55:28.343862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 02ea638b-e76a-43d4-a7af-3b5be374e752 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:28.344279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for cfbaf355-dc65-4e70-a31f-49dfe300f3d3 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:28.344835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 2d687c63-2eda-4404-94d4-512d1659dd28 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:28.345326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for fe0c83f1-a5c5-47bb-a91f-c709bd53e220 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:28.347214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Resource SecurityGroupRule deleted: 9cb5e485-0748-44a7-aa66-ad41d6765fcd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:28.347744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9cb5e485-0748-44a7-aa66-ad41d6765fcd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:28.348223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:28.348942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Resource SecurityGroupRule deleted: da0764d2-b306-4984-9067-ef970fcc7cf3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:28.349447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (da0764d2-b306-4984-9067-ef970fcc7cf3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:28.349926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:28.350460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Resource SecurityGroupRule deleted: e9d6b378-0df9-4b75-839e-fa623e747fbf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:28.351073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e9d6b378-0df9-4b75-839e-fa623e747fbf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:28.351542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-caa36798-0dab-446f-a76a-a7a21d8464cb admin admin] Security group rule updated ['e7163c69-1289-4763-b6ee-cd204a523d54'] Oct 23 00:55:29.529899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bd73529f-3d21-447f-aa8b-2533cdebe197 admin admin] Received resource Port update without any changes: 1af047de-df31-40f1-8ab4-6afa1a4ee2ae {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:55:30.083545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bcfdcb8d-26b8-4378-849f-c60adf62bbc1 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:29Z,data_plane_status=None,description='',device_id='fdd0b971-41e7-4c06-aca2-3799f3e76e98',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a,mac_address=fa:16:3e:fd:54:c7,name='',network_id=6e24fc8d-42d5-4d11-b06b-37a4738231b0,numa_affinity_policy=,project_id='2a9697845193443ea394c1b480b6b769',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:30.083978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bcfdcb8d-26b8-4378-849f-c60adf62bbc1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:30.292454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2bd7fde3-408c-42dd-920c-0896c5fcae7a admin admin] Resource Subnet deleted: e8caf190-1929-4d28-927b-ec9b345ce0f1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:30.293034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2bd7fde3-408c-42dd-920c-0896c5fcae7a admin admin] Publish callbacks [] for Subnet (e8caf190-1929-4d28-927b-ec9b345ce0f1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:30.383043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1269d97d-82df-4022-b431-d2c089ff6e71 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:25Z,data_plane_status=None,description='',device_id='b19da5af-947c-410a-bc2b-a0b1941e7211',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,mac_address=fa:16:3e:3b:d1:28,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c3d281d7-77bc-45d4-bfbc-c30a363df5dd),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:27Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:30.386903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1269d97d-82df-4022-b431-d2c089ff6e71 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c3d281d7-77bc-45d4-bfbc-c30a363df5dd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:30.718529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d51d431b-54b2-40c8-88b5-b06e31ee51d4 None None] Resource Port 2d687c63-2eda-4404-94d4-512d1659dd28 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:30.722148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d51d431b-54b2-40c8-88b5-b06e31ee51d4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2d687c63-2eda-4404-94d4-512d1659dd28), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:30.827187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 02ea638b-e76a-43d4-a7af-3b5be374e752 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:30.827623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (02ea638b-e76a-43d4-a7af-3b5be374e752), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:31.240771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bcfdcb8d-26b8-4378-849f-c60adf62bbc1 admin admin] Received resource Port update without any changes: 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:55:31.314256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-43a04449-3a56-4702-835e-8168501b155f None None] Resource Port fe0c83f1-a5c5-47bb-a91f-c709bd53e220 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:31.315426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-43a04449-3a56-4702-835e-8168501b155f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fe0c83f1-a5c5-47bb-a91f-c709bd53e220), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:31.697212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port cfbaf355-dc65-4e70-a31f-49dfe300f3d3 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=cfbaf355-dc65-4e70-a31f-49dfe300f3d3,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:31.697620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cfbaf355-dc65-4e70-a31f-49dfe300f3d3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:31.742213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cb5fd915-15b7-4795-9753-cf943dea5257 None None] Resource Port e10e1214-c988-4645-bc00-e42d4d9a7e6b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:31.743565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cb5fd915-15b7-4795-9753-cf943dea5257 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e10e1214-c988-4645-bc00-e42d4d9a7e6b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.239408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cb5fd915-15b7-4795-9753-cf943dea5257 None None] Resource Port e10e1214-c988-4645-bc00-e42d4d9a7e6b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:32.239803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cb5fd915-15b7-4795-9753-cf943dea5257 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e10e1214-c988-4645-bc00-e42d4d9a7e6b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.292372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:31Z,description='Default security group',id=6d557c9d-c255-4d7d-bae1-00a2ca9081d5,is_default=True,name='default',project_id='4127b2e2de074ac6b1f874b8ee1c7223',revision_number=1,rules=[SecurityGroupRule(1d44b3dc-c056-45a5-acb3-f6c426cf0a81),SecurityGroupRule(558af18a-5126-4c85-8e53-e324d5f41dcf),SecurityGroupRule(8c7fe6e7-3400-445b-8b80-f6fd5803ccc9),SecurityGroupRule(cd9f453b-b238-48a2-89eb-bd4bbe6737b9)],shared=False,stateful=True,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.293892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (6d557c9d-c255-4d7d-bae1-00a2ca9081d5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.294761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:32Z,description=,direction='egress',ethertype='IPv4',id=1d44b3dc-c056-45a5-acb3-f6c426cf0a81,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4127b2e2de074ac6b1f874b8ee1c7223',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6d557c9d-c255-4d7d-bae1-00a2ca9081d5,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.295901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1d44b3dc-c056-45a5-acb3-f6c426cf0a81), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.296666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.299437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:32Z,description=,direction='ingress',ethertype='IPv6',id=558af18a-5126-4c85-8e53-e324d5f41dcf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4127b2e2de074ac6b1f874b8ee1c7223',protocol=,remote_address_group_id=,remote_group_id=6d557c9d-c255-4d7d-bae1-00a2ca9081d5,remote_ip_prefix=,revision_number=0,security_group_id=6d557c9d-c255-4d7d-bae1-00a2ca9081d5,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.302332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (558af18a-5126-4c85-8e53-e324d5f41dcf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.316917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.319570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:32Z,description=,direction='egress',ethertype='IPv6',id=8c7fe6e7-3400-445b-8b80-f6fd5803ccc9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4127b2e2de074ac6b1f874b8ee1c7223',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6d557c9d-c255-4d7d-bae1-00a2ca9081d5,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.320132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8c7fe6e7-3400-445b-8b80-f6fd5803ccc9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.320702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.321836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:31Z,description=,direction='ingress',ethertype='IPv4',id=cd9f453b-b238-48a2-89eb-bd4bbe6737b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4127b2e2de074ac6b1f874b8ee1c7223',protocol=,remote_address_group_id=,remote_group_id=6d557c9d-c255-4d7d-bae1-00a2ca9081d5,remote_ip_prefix=,revision_number=0,security_group_id=6d557c9d-c255-4d7d-bae1-00a2ca9081d5,updated_at=2022-10-23T00:55:31Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.322456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (cd9f453b-b238-48a2-89eb-bd4bbe6737b9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.323170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c9f7442d-d619-42b5-8233-8468b89ab046 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.762663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['02ea638b-e76a-43d4-a7af-3b5be374e752', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220'] and devices down [] completed. Oct 23 00:55:32.763350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:241 - ports processed. Elapsed:4.928 Oct 23 00:55:32.763922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:241 completed. Processed ports statistics: {'regular': {'added': 4, 'updated': 3, 'removed': 0}}. Elapsed:4.929 Oct 23 00:55:32.764706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Loop iteration exceeded interval (2 vs. 4.928779602050781)! {{(pid=105573) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 23 00:55:32.765249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:242 started Oct 23 00:55:32.773805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=841000000,duration_sec=493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:32.775718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:32.776060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:242 - starting polling. Elapsed:0.011 Oct 23 00:55:32.786330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.797806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:242 - port information retrieved. Elapsed:0.032 Oct 23 00:55:32.798111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39'}, 'added': set(), 'removed': set(), 'updated': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '2d687c63-2eda-4404-94d4-512d1659dd28', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:32.798697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'mac_address': 'fa:16:3e:c6:9d:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:32.799158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '2d687c63-2eda-4404-94d4-512d1659dd28', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': '2d687c63-2eda-4404-94d4-512d1659dd28', 'mac_address': 'fa:16:3e:4f:02:78', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:32.806815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'mac_address': 'fa:16:3e:35:08:26', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:32.808436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'mac_address': 'fa:16:3e:6d:af:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.240'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:32.818019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 02ea638b-e76a-43d4-a7af-3b5be374e752 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:32.818369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 02ea638b-e76a-43d4-a7af-3b5be374e752 updated. Details: {'device': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '02ea638b-e76a-43d4-a7af-3b5be374e752', 'mac_address': 'fa:16:3e:c6:9d:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 23 00:55:32.827062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap02ea638b-e7, col_values=(('tag', 5),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.829104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap02ea638b-e7, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.834149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap02ea638b-e7, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.835829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.858961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Resource SecurityGroup deleted: 6d557c9d-c255-4d7d-bae1-00a2ca9081d5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:32.861817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (6d557c9d-c255-4d7d-bae1-00a2ca9081d5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.862524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6d557c9d-c255-4d7d-bae1-00a2ca9081d5',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:32.874501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:32Z,description='Default security group',id=16a5a7d0-ba14-40fe-96ac-812ad9bc76d8,is_default=True,name='default',project_id='95c837ad679b47c4abc0c12efd344533',revision_number=1,rules=[SecurityGroupRule(2d902970-9207-487c-87b7-a3da3c53d4da),SecurityGroupRule(4d5704e4-db7d-4bf0-bcdc-10f59d5275b9),SecurityGroupRule(9ddc76a5-5e77-408a-92cb-de96a6bdd56c),SecurityGroupRule(c260144a-966e-4d53-bf0f-e7cb6d0e0b99)],shared=False,stateful=True,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.874988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (16a5a7d0-ba14-40fe-96ac-812ad9bc76d8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.875849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:32Z,description=,direction='egress',ethertype='IPv4',id=2d902970-9207-487c-87b7-a3da3c53d4da,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95c837ad679b47c4abc0c12efd344533',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=16a5a7d0-ba14-40fe-96ac-812ad9bc76d8,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.876713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2d902970-9207-487c-87b7-a3da3c53d4da), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.877303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:32.878213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:32Z,description=,direction='ingress',ethertype='IPv6',id=4d5704e4-db7d-4bf0-bcdc-10f59d5275b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95c837ad679b47c4abc0c12efd344533',protocol=,remote_address_group_id=,remote_group_id=16a5a7d0-ba14-40fe-96ac-812ad9bc76d8,remote_ip_prefix=,revision_number=0,security_group_id=16a5a7d0-ba14-40fe-96ac-812ad9bc76d8,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.878809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4d5704e4-db7d-4bf0-bcdc-10f59d5275b9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.879337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:32.880248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:32Z,description=,direction='ingress',ethertype='IPv4',id=9ddc76a5-5e77-408a-92cb-de96a6bdd56c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95c837ad679b47c4abc0c12efd344533',protocol=,remote_address_group_id=,remote_group_id=16a5a7d0-ba14-40fe-96ac-812ad9bc76d8,remote_ip_prefix=,revision_number=0,security_group_id=16a5a7d0-ba14-40fe-96ac-812ad9bc76d8,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.880860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9ddc76a5-5e77-408a-92cb-de96a6bdd56c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.883085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:32.884005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:32Z,description=,direction='egress',ethertype='IPv6',id=c260144a-966e-4d53-bf0f-e7cb6d0e0b99,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95c837ad679b47c4abc0c12efd344533',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=16a5a7d0-ba14-40fe-96ac-812ad9bc76d8,updated_at=2022-10-23T00:55:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:32.884577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c260144a-966e-4d53-bf0f-e7cb6d0e0b99), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.885859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd4179fa-9690-4d0a-a558-92c13570b34b admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:32.886915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap02ea638b-e7, col_values=(('other_config', {'net_uuid': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '356', 'tag': '5'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.892917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.895052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9d06d7b2-ea08-4e03-98ab-cf98f7fb9918 admin admin] Resource Network deleted: 2298bb57-87bf-4fb3-94ad-a41a984ccdae {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:32.895658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9d06d7b2-ea08-4e03-98ab-cf98f7fb9918 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (2298bb57-87bf-4fb3-94ad-a41a984ccdae), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.905799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a5a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:32.909192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 2d687c63-2eda-4404-94d4-512d1659dd28 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:32.909809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2d687c63-2eda-4404-94d4-512d1659dd28 updated. Details: {'device': '2d687c63-2eda-4404-94d4-512d1659dd28', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': '2d687c63-2eda-4404-94d4-512d1659dd28', 'mac_address': 'fa:16:3e:4f:02:78', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 23 00:55:32.911183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d687c63-2e, col_values=(('tag', 6),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.913510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap2d687c63-2e, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.914171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap2d687c63-2e, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.914839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.919667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d687c63-2e, col_values=(('other_config', {'net_uuid': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '366', 'tag': '6'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.920946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.926878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a5c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:32.929420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: fe0c83f1-a5c5-47bb-a91f-c709bd53e220 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:32.933863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port fe0c83f1-a5c5-47bb-a91f-c709bd53e220 updated. Details: {'device': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'mac_address': 'fa:16:3e:35:08:26', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 23 00:55:32.935295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe0c83f1-a5, col_values=(('tag', 7),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.935956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfe0c83f1-a5, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.936813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfe0c83f1-a5, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.937675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.940123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6d557c9d-c255-4d7d-bae1-00a2ca9081d5',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:32.944112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Resource SecurityGroupRule deleted: 1d44b3dc-c056-45a5-acb3-f6c426cf0a81 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:32.944709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1d44b3dc-c056-45a5-acb3-f6c426cf0a81), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.950310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.950974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Resource SecurityGroupRule deleted: 558af18a-5126-4c85-8e53-e324d5f41dcf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:32.951544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (558af18a-5126-4c85-8e53-e324d5f41dcf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.952166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.952900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Resource SecurityGroupRule deleted: 8c7fe6e7-3400-445b-8b80-f6fd5803ccc9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:32.953900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8c7fe6e7-3400-445b-8b80-f6fd5803ccc9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.954451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.955031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Resource SecurityGroupRule deleted: cd9f453b-b238-48a2-89eb-bd4bbe6737b9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:32.955597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (cd9f453b-b238-48a2-89eb-bd4bbe6737b9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:32.956138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7df8f268-99f4-443c-9ee7-f684e1effa18 admin admin] Security group rule updated ['6d557c9d-c255-4d7d-bae1-00a2ca9081d5'] Oct 23 00:55:32.957426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe0c83f1-a5, col_values=(('other_config', {'net_uuid': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '399', 'tag': '7'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.958414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.963091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a5e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:32.963742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: cfbaf355-dc65-4e70-a31f-49dfe300f3d3 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:32.964634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port cfbaf355-dc65-4e70-a31f-49dfe300f3d3 updated. Details: {'device': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', 'mac_address': 'fa:16:3e:6d:af:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.240'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:32.965898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-cfbaf355-dc, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.966553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-cfbaf355-dc, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.967162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-cfbaf355-dc, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.967814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.970010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-cfbaf355-dc, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:32.970918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:32.975202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a60,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:32.975793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:242 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.177 Oct 23 00:55:32.976379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 4 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:32.976905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:32.979973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:32.980489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:32.987455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:33.085299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd30d96-eb16-456c-b57b-8d7f855e5a18]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:33.085906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:242 - agent port security group processed in 0.287 Oct 23 00:55:33.086729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 02ea638b-e76a-43d4-a7af-3b5be374e752 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:33.087033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 2d687c63-2eda-4404-94d4-512d1659dd28 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:33.087343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for fe0c83f1-a5c5-47bb-a91f-c709bd53e220 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:33.087655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for cfbaf355-dc65-4e70-a31f-49dfe300f3d3 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:33.500324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfafc0e4-19c0-4b95-a919-8e448062d7be admin admin] Resource Subnet deleted: fac20a69-0883-4ad5-8616-bfb98513cb28 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:33.501997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfafc0e4-19c0-4b95-a919-8e448062d7be admin admin] Publish callbacks [] for Subnet (fac20a69-0883-4ad5-8616-bfb98513cb28), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.548590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["86caff51-aeca-4041-9529-2c67dbe4ccee","insert","qr-9b1d8b2e-51",["set",[]],["map",[["attached-mac","fa:16:3e:fd:54:c7"],["iface-id","9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:33.595678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["86caff51-aeca-4041-9529-2c67dbe4ccee","old",null,["set",[]],null],["","new","qr-9b1d8b2e-51",11,["map",[["attached-mac","fa:16:3e:fd:54:c7"],["iface-id","9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:33.615992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d3bf3cf6-316c-4def-814c-038b8844ddd5 None None] Resource Port f0e20492-cd09-472c-ad67-7a194ee39b4a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=f0e20492-cd09-472c-ad67-7a194ee39b4a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f0e20492-cd09-472c-ad67-7a194ee39b4a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:33.616588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d3bf3cf6-316c-4def-814c-038b8844ddd5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f0e20492-cd09-472c-ad67-7a194ee39b4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.689768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Resource SecurityGroup deleted: 16a5a7d0-ba14-40fe-96ac-812ad9bc76d8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:33.690384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (16a5a7d0-ba14-40fe-96ac-812ad9bc76d8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.691061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('16a5a7d0-ba14-40fe-96ac-812ad9bc76d8',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:33.770770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('16a5a7d0-ba14-40fe-96ac-812ad9bc76d8',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:33.772234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Resource SecurityGroupRule deleted: 2d902970-9207-487c-87b7-a3da3c53d4da {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:33.772860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2d902970-9207-487c-87b7-a3da3c53d4da), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.773437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:33.774050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Resource SecurityGroupRule deleted: 4d5704e4-db7d-4bf0-bcdc-10f59d5275b9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:33.774601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4d5704e4-db7d-4bf0-bcdc-10f59d5275b9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.775156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:33.775885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Resource SecurityGroupRule deleted: 9ddc76a5-5e77-408a-92cb-de96a6bdd56c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:33.776456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9ddc76a5-5e77-408a-92cb-de96a6bdd56c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.777009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:33.778418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Resource SecurityGroupRule deleted: c260144a-966e-4d53-bf0f-e7cb6d0e0b99 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:33.779001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c260144a-966e-4d53-bf0f-e7cb6d0e0b99), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.779540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a095ab4c-0644-4ad7-9421-a48eccc2d4b7 admin admin] Security group rule updated ['16a5a7d0-ba14-40fe-96ac-812ad9bc76d8'] Oct 23 00:55:33.968530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:33Z,description='tempest-description--2002163688',id=eab29425-121c-4f20-9db4-0aad6675d57d,is_default=False,name='tempest-securitygroup--328009685',project_id='2a9697845193443ea394c1b480b6b769',revision_number=1,rules=[SecurityGroupRule(73427c94-904e-4268-ba7c-9cb1683a1edf),SecurityGroupRule(b9953073-a1f9-4d10-8748-02de2be40e50)],shared=False,stateful=True,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:33.969630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (eab29425-121c-4f20-9db4-0aad6675d57d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.973302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:33Z,description=,direction='egress',ethertype='IPv6',id=73427c94-904e-4268-ba7c-9cb1683a1edf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eab29425-121c-4f20-9db4-0aad6675d57d,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:33.974433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (73427c94-904e-4268-ba7c-9cb1683a1edf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.976503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 00:55:33.979459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:33Z,description=,direction='egress',ethertype='IPv4',id=b9953073-a1f9-4d10-8748-02de2be40e50,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eab29425-121c-4f20-9db4-0aad6675d57d,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:33.980261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b9953073-a1f9-4d10-8748-02de2be40e50), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:33.980864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f5ee40d6-0993-478d-8724-de0a681a2c20 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 00:55:34.061453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['02ea638b-e76a-43d4-a7af-3b5be374e752', '2d687c63-2eda-4404-94d4-512d1659dd28', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3'] and devices down [] completed. Oct 23 00:55:34.062316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:242 - ports processed. Elapsed:1.297 Oct 23 00:55:34.063223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:242 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 4, 'removed': 0}}. Elapsed:1.298 Oct 23 00:55:34.346341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1d596505-5362-4673-8635-02584d2dda84","insert","qg-e10e1214-c9",["set",[]],["map",[["attached-mac","fa:16:3e:7a:80:7c"],["iface-id","e10e1214-c988-4645-bc00-e42d4d9a7e6b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:34.376935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1d596505-5362-4673-8635-02584d2dda84","old",null,["set",[]],null],["","new","qg-e10e1214-c9",12,["map",[["attached-mac","fa:16:3e:7a:80:7c"],["iface-id","e10e1214-c988-4645-bc00-e42d4d9a7e6b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:34.598247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d3bf3cf6-316c-4def-814c-038b8844ddd5 None None] Resource Port f0e20492-cd09-472c-ad67-7a194ee39b4a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f0e20492-cd09-472c-ad67-7a194ee39b4a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f0e20492-cd09-472c-ad67-7a194ee39b4a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f0e20492-cd09-472c-ad67-7a194ee39b4a,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:34.598633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d3bf3cf6-316c-4def-814c-038b8844ddd5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f0e20492-cd09-472c-ad67-7a194ee39b4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:34.766873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:243 started Oct 23 00:55:34.770926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=841000000,duration_sec=495,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:34.772287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:34.773036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:243 - starting polling. Elapsed:0.006 Oct 23 00:55:34.775407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:34.791671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:243 - port information retrieved. Elapsed:0.025 Oct 23 00:55:34.792555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'added': {'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:34.793396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'mac_address': 'fa:16:3e:7a:80:7c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.245'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:34.794523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:29Z,data_plane_status=None,description='',device_id='fdd0b971-41e7-4c06-aca2-3799f3e76e98',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a,mac_address=fa:16:3e:fd:54:c7,name='',network_id=6e24fc8d-42d5-4d11-b06b-37a4738231b0,numa_affinity_policy=,project_id='2a9697845193443ea394c1b480b6b769',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:30Z) is not bound. Oct 23 00:55:34.797766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: e10e1214-c988-4645-bc00-e42d4d9a7e6b {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:34.800301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port e10e1214-c988-4645-bc00-e42d4d9a7e6b updated. Details: {'device': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'mac_address': 'fa:16:3e:7a:80:7c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.245'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:34.803730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e10e1214-c9, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:34.809835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e10e1214-c9, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:34.825690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e10e1214-c9, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:34.839349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e10e1214-c9, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:34.856314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a64,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:34.857036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:34.858376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a not defined on plugin or binding failed Oct 23 00:55:34.861205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:243 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.066 Oct 23 00:55:34.861959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 2 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:55:34.862455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'} Oct 23 00:55:34.866764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:34.869940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:34.892242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:34.905076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9436004a-019d-4d69-a457-122d8d1bc05d tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:34Z,description='',direction='ingress',ethertype='IPv4',id=8d4d375d-2751-4c38-bbdc-ee99bd63da89,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='2a9697845193443ea394c1b480b6b769',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eab29425-121c-4f20-9db4-0aad6675d57d,updated_at=2022-10-23T00:55:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:34.906195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9436004a-019d-4d69-a457-122d8d1bc05d tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8d4d375d-2751-4c38-bbdc-ee99bd63da89), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:34.908916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9436004a-019d-4d69-a457-122d8d1bc05d tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 00:55:35.010387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[084749e6-7dad-48fa-8b93-4ee2fb83c85b]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:35.011047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:243 - agent port security group processed in 0.218 Oct 23 00:55:35.011770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for e10e1214-c988-4645-bc00-e42d4d9a7e6b to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:35.332301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:33Z,description='Default security group',id=0a94855e-5d3b-4a2a-b8d1-67b87e75458b,is_default=True,name='default',project_id='50ba9b0a5b1e428ba69744e5e20a8543',revision_number=1,rules=[SecurityGroupRule(02d11955-2867-42fa-adcd-0981ad3ec982),SecurityGroupRule(9dcbb148-2fd6-4040-a63e-50aa7ec4f445),SecurityGroupRule(ae644776-e781-4507-9bd7-accb7cc30208),SecurityGroupRule(b02ef0b8-de31-4423-9302-9e1615001bd3)],shared=False,stateful=True,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:35.332689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (0a94855e-5d3b-4a2a-b8d1-67b87e75458b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:35.333325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:33Z,description=,direction='egress',ethertype='IPv6',id=02d11955-2867-42fa-adcd-0981ad3ec982,normalized_cidr=None,port_range_max=,port_range_min=,project_id='50ba9b0a5b1e428ba69744e5e20a8543',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a94855e-5d3b-4a2a-b8d1-67b87e75458b,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:35.333867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (02d11955-2867-42fa-adcd-0981ad3ec982), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:35.334515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:35.335331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:33Z,description=,direction='ingress',ethertype='IPv6',id=9dcbb148-2fd6-4040-a63e-50aa7ec4f445,normalized_cidr=None,port_range_max=,port_range_min=,project_id='50ba9b0a5b1e428ba69744e5e20a8543',protocol=,remote_address_group_id=,remote_group_id=0a94855e-5d3b-4a2a-b8d1-67b87e75458b,remote_ip_prefix=,revision_number=0,security_group_id=0a94855e-5d3b-4a2a-b8d1-67b87e75458b,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:35.335865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9dcbb148-2fd6-4040-a63e-50aa7ec4f445), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:35.336342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:35.337338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:33Z,description=,direction='ingress',ethertype='IPv4',id=ae644776-e781-4507-9bd7-accb7cc30208,normalized_cidr=None,port_range_max=,port_range_min=,project_id='50ba9b0a5b1e428ba69744e5e20a8543',protocol=,remote_address_group_id=,remote_group_id=0a94855e-5d3b-4a2a-b8d1-67b87e75458b,remote_ip_prefix=,revision_number=0,security_group_id=0a94855e-5d3b-4a2a-b8d1-67b87e75458b,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:35.337879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ae644776-e781-4507-9bd7-accb7cc30208), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:35.341562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:35.342708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:33Z,description=,direction='egress',ethertype='IPv4',id=b02ef0b8-de31-4423-9302-9e1615001bd3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='50ba9b0a5b1e428ba69744e5e20a8543',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a94855e-5d3b-4a2a-b8d1-67b87e75458b,updated_at=2022-10-23T00:55:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:35.345202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b02ef0b8-de31-4423-9302-9e1615001bd3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:35.346052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8b55cb17-c47f-41a4-9b25-a46e12f08a95 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:35.354837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["41a953aa-1247-43c1-8d59-84cad7121096","insert","qg-f0e20492-cd",["set",[]],["map",[["attached-mac","fa:16:3e:c5:d9:ea"],["iface-id","f0e20492-cd09-472c-ad67-7a194ee39b4a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:35.379695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["41a953aa-1247-43c1-8d59-84cad7121096","old",null,["set",[]],null],["","new","qg-f0e20492-cd",13,["map",[["attached-mac","fa:16:3e:c5:d9:ea"],["iface-id","f0e20492-cd09-472c-ad67-7a194ee39b4a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:35.852645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3be12843-e518-4fd8-b929-c971683412c6 None None] Resource Port 1af047de-df31-40f1-8ab4-6afa1a4ee2ae updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=1af047de-df31-40f1-8ab4-6afa1a4ee2ae,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1af047de-df31-40f1-8ab4-6afa1a4ee2ae,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:35.853334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3be12843-e518-4fd8-b929-c971683412c6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (1af047de-df31-40f1-8ab4-6afa1a4ee2ae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.084669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ca01093-6c68-4e5a-829f-f72833e1a57b tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:35Z,description='',direction='ingress',ethertype='IPv4',id=5b7853dd-917c-47c4-89a0-cd6e9d6d5236,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eab29425-121c-4f20-9db4-0aad6675d57d,updated_at=2022-10-23T00:55:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:36.085375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ca01093-6c68-4e5a-829f-f72833e1a57b tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5b7853dd-917c-47c4-89a0-cd6e9d6d5236), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.085895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3ca01093-6c68-4e5a-829f-f72833e1a57b tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 00:55:36.122900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:35Z,description='Default security group',id=38598b96-9d1e-462f-b954-b18a6aa3db1e,is_default=True,name='default',project_id='e7e4079245674454b0abc50c926c74bc',revision_number=1,rules=[SecurityGroupRule(049cee24-51ed-4d94-9214-4f633a5ee7d7),SecurityGroupRule(dfdcd48b-b54c-42c1-abc3-ca2eb6321159),SecurityGroupRule(e6ae46b2-62c6-41c9-a068-c808e4b055f9),SecurityGroupRule(f2369445-a962-4a12-bb57-086bbeef04ce)],shared=False,stateful=True,updated_at=2022-10-23T00:55:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:36.123656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (38598b96-9d1e-462f-b954-b18a6aa3db1e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.124755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:35Z,description=,direction='egress',ethertype='IPv6',id=049cee24-51ed-4d94-9214-4f633a5ee7d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4079245674454b0abc50c926c74bc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38598b96-9d1e-462f-b954-b18a6aa3db1e,updated_at=2022-10-23T00:55:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:36.125411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (049cee24-51ed-4d94-9214-4f633a5ee7d7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.126094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:36.127937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:35Z,description=,direction='egress',ethertype='IPv4',id=dfdcd48b-b54c-42c1-abc3-ca2eb6321159,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4079245674454b0abc50c926c74bc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38598b96-9d1e-462f-b954-b18a6aa3db1e,updated_at=2022-10-23T00:55:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:36.129677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (dfdcd48b-b54c-42c1-abc3-ca2eb6321159), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.130631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:36.131588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:35Z,description=,direction='ingress',ethertype='IPv4',id=e6ae46b2-62c6-41c9-a068-c808e4b055f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4079245674454b0abc50c926c74bc',protocol=,remote_address_group_id=,remote_group_id=38598b96-9d1e-462f-b954-b18a6aa3db1e,remote_ip_prefix=,revision_number=0,security_group_id=38598b96-9d1e-462f-b954-b18a6aa3db1e,updated_at=2022-10-23T00:55:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:36.137097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e6ae46b2-62c6-41c9-a068-c808e4b055f9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.137659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:36.140957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:35Z,description=,direction='ingress',ethertype='IPv6',id=f2369445-a962-4a12-bb57-086bbeef04ce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4079245674454b0abc50c926c74bc',protocol=,remote_address_group_id=,remote_group_id=38598b96-9d1e-462f-b954-b18a6aa3db1e,remote_ip_prefix=,revision_number=0,security_group_id=38598b96-9d1e-462f-b954-b18a6aa3db1e,updated_at=2022-10-23T00:55:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:36.142654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f2369445-a962-4a12-bb57-086bbeef04ce), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.144034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ee229f77-d0ea-406c-8cf5-8005494e53a1 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:36.158743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Resource SecurityGroup deleted: 0a94855e-5d3b-4a2a-b8d1-67b87e75458b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:36.160320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (0a94855e-5d3b-4a2a-b8d1-67b87e75458b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.162041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0a94855e-5d3b-4a2a-b8d1-67b87e75458b',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:36.242122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0a94855e-5d3b-4a2a-b8d1-67b87e75458b',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:36.243077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Resource SecurityGroupRule deleted: 02d11955-2867-42fa-adcd-0981ad3ec982 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:36.243642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (02d11955-2867-42fa-adcd-0981ad3ec982), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.244532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:36.245288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Resource SecurityGroupRule deleted: 9dcbb148-2fd6-4040-a63e-50aa7ec4f445 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:36.245798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9dcbb148-2fd6-4040-a63e-50aa7ec4f445), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.246440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:36.247001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Resource SecurityGroupRule deleted: ae644776-e781-4507-9bd7-accb7cc30208 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:36.247643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ae644776-e781-4507-9bd7-accb7cc30208), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.248176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:36.248752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Resource SecurityGroupRule deleted: b02ef0b8-de31-4423-9302-9e1615001bd3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:36.249698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b02ef0b8-de31-4423-9302-9e1615001bd3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.250574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a87a3a5e-9ba2-4416-91e6-64e141b2d9c8 admin admin] Security group rule updated ['0a94855e-5d3b-4a2a-b8d1-67b87e75458b'] Oct 23 00:55:36.272535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4b97d95d-68ae-4448-a40a-377d476e96c0 admin admin] Resource Network deleted: b1925aa5-5761-41a7-815b-1f0974e3c32c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:36.273134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4b97d95d-68ae-4448-a40a-377d476e96c0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (b1925aa5-5761-41a7-815b-1f0974e3c32c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.326485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-850cce62-adc1-48d5-8dbc-ed68ceb7c9af admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:34Z,data_plane_status=None,description='',device_id='2d77609f-f6a2-4b66-94b2-dbd18b570cb6',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c15a8bad-19fd-46da-8328-6797a742506a,mac_address=fa:16:3e:86:80:f4,name='',network_id=1d27b6d9-fef6-49cb-833f-13cb9578958e,numa_affinity_policy=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c15a8bad-19fd-46da-8328-6797a742506a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:36.326956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-850cce62-adc1-48d5-8dbc-ed68ceb7c9af admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c15a8bad-19fd-46da-8328-6797a742506a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.350038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['e10e1214-c988-4645-bc00-e42d4d9a7e6b'] and devices down [] completed. Oct 23 00:55:36.350357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:243 - ports processed. Elapsed:1.584 Oct 23 00:55:36.350689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:243 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:1.584 Oct 23 00:55:36.651264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port e10e1214-c988-4645-bc00-e42d4d9a7e6b updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e10e1214-c988-4645-bc00-e42d4d9a7e6b,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:36.651639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e10e1214-c988-4645-bc00-e42d4d9a7e6b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.768883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:244 started Oct 23 00:55:36.772185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=843000000,duration_sec=497,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:36.773247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:36.774810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:244 - starting polling. Elapsed:0.005 Oct 23 00:55:36.777666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:36.783851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:244 - port information retrieved. Elapsed:0.015 Oct 23 00:55:36.784180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'added': {'f0e20492-cd09-472c-ad67-7a194ee39b4a'}, 'removed': set(), 'updated': {'e10e1214-c988-4645-bc00-e42d4d9a7e6b'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:36.788963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'mac_address': 'fa:16:3e:c5:d9:ea', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.144'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:36.789658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'mac_address': 'fa:16:3e:7a:80:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.245'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:36.803707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: f0e20492-cd09-472c-ad67-7a194ee39b4a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:36.805558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port f0e20492-cd09-472c-ad67-7a194ee39b4a updated. Details: {'device': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'mac_address': 'fa:16:3e:c5:d9:ea', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.144'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:36.808065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f0e20492-cd, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.810016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f0e20492-cd, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.813693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f0e20492-cd, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.824044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f0e20492-cd, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.857183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a68,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:36.869681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: e10e1214-c988-4645-bc00-e42d4d9a7e6b {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:36.870186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port e10e1214-c988-4645-bc00-e42d4d9a7e6b updated. Details: {'device': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'mac_address': 'fa:16:3e:7a:80:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.245'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:36.879447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e10e1214-c9, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.880517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e10e1214-c9, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.881237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e10e1214-c9, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.882292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:36.885640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e10e1214-c9, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:36.888111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:36.893131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a6a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:36.894614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:244 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.109 Oct 23 00:55:36.895643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:55:36.896089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'f0e20492-cd09-472c-ad67-7a194ee39b4a'} Oct 23 00:55:36.898557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:36.899059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:36.913887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:36.921765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b3871265-c270-49c6-a48b-63126279bb58 None None] Resource Port c3d281d7-77bc-45d4-bfbc-c30a363df5dd updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:36.923820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b3871265-c270-49c6-a48b-63126279bb58 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c3d281d7-77bc-45d4-bfbc-c30a363df5dd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.017043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2dc114-be1f-48b3-bb7d-341c69d4727f]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:37.018359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:37.018871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:37.021232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:37.021737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:37.027062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:37.092375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e405c-4069-476a-aad7-372b76e23511]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:37.097708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:244 - agent port security group processed in 0.313 Oct 23 00:55:37.100522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for f0e20492-cd09-472c-ad67-7a194ee39b4a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:37.101320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for e10e1214-c988-4645-bc00-e42d4d9a7e6b to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:37.224115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Resource SecurityGroup deleted: 38598b96-9d1e-462f-b954-b18a6aa3db1e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:37.225138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (38598b96-9d1e-462f-b954-b18a6aa3db1e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.225884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('38598b96-9d1e-462f-b954-b18a6aa3db1e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:37.281400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3be12843-e518-4fd8-b929-c971683412c6 None None] Resource Port 1af047de-df31-40f1-8ab4-6afa1a4ee2ae updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1af047de-df31-40f1-8ab4-6afa1a4ee2ae,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1af047de-df31-40f1-8ab4-6afa1a4ee2ae,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1af047de-df31-40f1-8ab4-6afa1a4ee2ae,segment=NetworkSegment(b638209f-90ba-44ee-80d1-50cdacceb6dc),segment_id=b638209f-90ba-44ee-80d1-50cdacceb6dc)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:37.282136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3be12843-e518-4fd8-b929-c971683412c6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (1af047de-df31-40f1-8ab4-6afa1a4ee2ae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.414787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('38598b96-9d1e-462f-b954-b18a6aa3db1e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:37.416351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Resource SecurityGroupRule deleted: 049cee24-51ed-4d94-9214-4f633a5ee7d7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:37.416888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (049cee24-51ed-4d94-9214-4f633a5ee7d7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.417510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:37.417988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Resource SecurityGroupRule deleted: dfdcd48b-b54c-42c1-abc3-ca2eb6321159 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:37.418464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (dfdcd48b-b54c-42c1-abc3-ca2eb6321159), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.419178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:37.419636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Resource SecurityGroupRule deleted: e6ae46b2-62c6-41c9-a068-c808e4b055f9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:37.420477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e6ae46b2-62c6-41c9-a068-c808e4b055f9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.421025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:37.422356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Resource SecurityGroupRule deleted: f2369445-a962-4a12-bb57-086bbeef04ce {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:37.423130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f2369445-a962-4a12-bb57-086bbeef04ce), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.423638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e6373473-8126-40e2-bd2a-85608b56a161 admin admin] Security group rule updated ['38598b96-9d1e-462f-b954-b18a6aa3db1e'] Oct 23 00:55:37.759428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60b22aa2-971f-42c9-8fbf-322bd8ecc489 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:36Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fcda428b-426f-4c8d-b0c2-a33f31d90d05,mac_address=fa:16:3e:90:bc:81,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fcda428b-426f-4c8d-b0c2-a33f31d90d05),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T00:55:37Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:37.760608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60b22aa2-971f-42c9-8fbf-322bd8ecc489 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fcda428b-426f-4c8d-b0c2-a33f31d90d05), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:37.845603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b3871265-c270-49c6-a48b-63126279bb58 None None] Resource Port c3d281d7-77bc-45d4-bfbc-c30a363df5dd updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:37.846335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b3871265-c270-49c6-a48b-63126279bb58 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c3d281d7-77bc-45d4-bfbc-c30a363df5dd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.057231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-850cce62-adc1-48d5-8dbc-ed68ceb7c9af admin admin] Received resource Port update without any changes: c15a8bad-19fd-46da-8328-6797a742506a {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:55:38.069564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Resource SecurityGroup deleted: d626a146-c254-4675-9b51-c62ab2dec6e7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:38.069942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (d626a146-c254-4675-9b51-c62ab2dec6e7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.071424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d626a146-c254-4675-9b51-c62ab2dec6e7',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:38.226443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:37Z,description='Default security group',id=1194f822-d870-4915-8c87-793620978013,is_default=True,name='default',project_id='30509024d1a147b18154311b2bfceb6f',revision_number=1,rules=[SecurityGroupRule(43bb274e-6e85-4399-b754-6d289195de95),SecurityGroupRule(6cfdd79f-d478-4d07-9d40-27cc946b5616),SecurityGroupRule(90992e7f-e783-4f51-b35e-53df6982001a),SecurityGroupRule(ded97fdf-fcea-44b5-9039-6f095007c757)],shared=False,stateful=True,updated_at=2022-10-23T00:55:37Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:38.226981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (1194f822-d870-4915-8c87-793620978013), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.227787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:37Z,description=,direction='egress',ethertype='IPv4',id=43bb274e-6e85-4399-b754-6d289195de95,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30509024d1a147b18154311b2bfceb6f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1194f822-d870-4915-8c87-793620978013,updated_at=2022-10-23T00:55:37Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:38.227974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (43bb274e-6e85-4399-b754-6d289195de95), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.228818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:38.229607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:37Z,description=,direction='ingress',ethertype='IPv4',id=6cfdd79f-d478-4d07-9d40-27cc946b5616,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30509024d1a147b18154311b2bfceb6f',protocol=,remote_address_group_id=,remote_group_id=1194f822-d870-4915-8c87-793620978013,remote_ip_prefix=,revision_number=0,security_group_id=1194f822-d870-4915-8c87-793620978013,updated_at=2022-10-23T00:55:37Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:38.230496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6cfdd79f-d478-4d07-9d40-27cc946b5616), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.230849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:38.232907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:37Z,description=,direction='egress',ethertype='IPv6',id=90992e7f-e783-4f51-b35e-53df6982001a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30509024d1a147b18154311b2bfceb6f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1194f822-d870-4915-8c87-793620978013,updated_at=2022-10-23T00:55:37Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:38.235363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (90992e7f-e783-4f51-b35e-53df6982001a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.235508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:38.243172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:37Z,description=,direction='ingress',ethertype='IPv6',id=ded97fdf-fcea-44b5-9039-6f095007c757,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30509024d1a147b18154311b2bfceb6f',protocol=,remote_address_group_id=,remote_group_id=1194f822-d870-4915-8c87-793620978013,remote_ip_prefix=,revision_number=0,security_group_id=1194f822-d870-4915-8c87-793620978013,updated_at=2022-10-23T00:55:37Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:38.243712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ded97fdf-fcea-44b5-9039-6f095007c757), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.246836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f1b7fe-c023-4d42-8778-2cb1b9183d74 admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:38.571425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d626a146-c254-4675-9b51-c62ab2dec6e7',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:38.572143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Resource SecurityGroupRule deleted: 241ce1d7-bb76-42cb-98a9-bc7fc8a3553a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:38.572761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (241ce1d7-bb76-42cb-98a9-bc7fc8a3553a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.573311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:38.574461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Resource SecurityGroupRule deleted: 24df7483-2e2a-4a87-9a28-fd8baefac08d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:38.575148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (24df7483-2e2a-4a87-9a28-fd8baefac08d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.575669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:38.577301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Resource SecurityGroupRule deleted: aea36b7b-d8e7-4a3e-bdbf-d0f2449d38d1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:38.577944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (aea36b7b-d8e7-4a3e-bdbf-d0f2449d38d1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.578486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:38.579184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Resource SecurityGroupRule deleted: d1025e85-97ec-4df8-a321-edf216033322 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:38.579714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d1025e85-97ec-4df8-a321-edf216033322), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:38.580468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-297dd738-dcab-435e-acd7-4bb4bcb3f4e7 admin admin] Security group rule updated ['d626a146-c254-4675-9b51-c62ab2dec6e7'] Oct 23 00:55:38.918015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6b80b97f-02d2-4c10-8dd6-b048bf93253a","insert","qg-c3d281d7-77",["set",[]],["map",[["attached-mac","fa:16:3e:3b:d1:28"],["iface-id","c3d281d7-77bc-45d4-bfbc-c30a363df5dd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:38.930898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6b80b97f-02d2-4c10-8dd6-b048bf93253a","old",null,["set",[]],null],["","new","qg-c3d281d7-77",14,["map",[["attached-mac","fa:16:3e:3b:d1:28"],["iface-id","c3d281d7-77bc-45d4-bfbc-c30a363df5dd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:39.049885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Resource SecurityGroup deleted: 1194f822-d870-4915-8c87-793620978013 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.050265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (1194f822-d870-4915-8c87-793620978013), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.050725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1194f822-d870-4915-8c87-793620978013',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:39.249089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5698bf39-1734-4974-906a-aaaff0418ca5 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:37Z,data_plane_status=None,description='',device_id='b19da5af-947c-410a-bc2b-a0b1941e7211',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=045e8cb5-b097-4c96-a318-d42be89b2e6f,mac_address=fa:16:3e:8e:5e:9a,name='',network_id=f8105e98-346f-4369-be4d-2cb2d399c07a,numa_affinity_policy=,project_id='59add4b78cd346a194c4be211d1996be',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(045e8cb5-b097-4c96-a318-d42be89b2e6f),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:55:38Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:39.250552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5698bf39-1734-4974-906a-aaaff0418ca5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (045e8cb5-b097-4c96-a318-d42be89b2e6f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.338263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60b22aa2-971f-42c9-8fbf-322bd8ecc489 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource Port fcda428b-426f-4c8d-b0c2-a33f31d90d05 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '2cd0df17-2206-487b-9468-d5d957b14fd7'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:39.338763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60b22aa2-971f-42c9-8fbf-322bd8ecc489 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fcda428b-426f-4c8d-b0c2-a33f31d90d05), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.525992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Resource SecurityGroup deleted: 2174eca8-40a2-4e04-af07-b35f82cfb2d3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.526712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (2174eca8-40a2-4e04-af07-b35f82cfb2d3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.527389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2174eca8-40a2-4e04-af07-b35f82cfb2d3',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:39.630592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1194f822-d870-4915-8c87-793620978013',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:39.631904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Resource SecurityGroupRule deleted: 43bb274e-6e85-4399-b754-6d289195de95 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.636210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (43bb274e-6e85-4399-b754-6d289195de95), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.636912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:39.637536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Resource SecurityGroupRule deleted: 6cfdd79f-d478-4d07-9d40-27cc946b5616 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.638124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6cfdd79f-d478-4d07-9d40-27cc946b5616), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.638648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:39.639217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Resource SecurityGroupRule deleted: 90992e7f-e783-4f51-b35e-53df6982001a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.639918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (90992e7f-e783-4f51-b35e-53df6982001a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.640616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:39.641330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Resource SecurityGroupRule deleted: ded97fdf-fcea-44b5-9039-6f095007c757 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.641892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ded97fdf-fcea-44b5-9039-6f095007c757), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.642420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c298af72-3062-455d-bd8a-3b57418288cd admin admin] Security group rule updated ['1194f822-d870-4915-8c87-793620978013'] Oct 23 00:55:39.723957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["25226760-e5e1-442c-8dd8-e5708f79b689","insert","qr-1af047de-df",["set",[]],["map",[["attached-mac","fa:16:3e:89:e0:2c"],["iface-id","1af047de-df31-40f1-8ab4-6afa1a4ee2ae"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:39.746575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["25226760-e5e1-442c-8dd8-e5708f79b689","old",null,["set",[]],null],["","new","qr-1af047de-df",15,["map",[["attached-mac","fa:16:3e:89:e0:2c"],["iface-id","1af047de-df31-40f1-8ab4-6afa1a4ee2ae"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:39.875950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2174eca8-40a2-4e04-af07-b35f82cfb2d3',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:39.876406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Resource SecurityGroupRule deleted: 487cc0e7-6f23-4a0f-98e2-acc50547e6a7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.876833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (487cc0e7-6f23-4a0f-98e2-acc50547e6a7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.877173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:39.877566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Resource SecurityGroupRule deleted: 7d49f29f-3666-4537-b3ac-ec9a81d56d9f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.877907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7d49f29f-3666-4537-b3ac-ec9a81d56d9f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.878225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:39.878596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Resource SecurityGroupRule deleted: ad03e885-17c6-4fc5-814c-233a8462c194 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.878959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ad03e885-17c6-4fc5-814c-233a8462c194), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.879240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:39.879607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Resource SecurityGroupRule deleted: ce36aa81-56c0-4aec-b0fb-bd3a0192f2af {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:39.879940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ce36aa81-56c0-4aec-b0fb-bd3a0192f2af), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:39.880463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9820cad3-ca7f-4727-998e-be79aea1fb4f admin admin] Security group rule updated ['2174eca8-40a2-4e04-af07-b35f82cfb2d3'] Oct 23 00:55:40.638572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port f0e20492-cd09-472c-ad67-7a194ee39b4a updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f0e20492-cd09-472c-ad67-7a194ee39b4a,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f0e20492-cd09-472c-ad67-7a194ee39b4a,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:40.640109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f0e20492-cd09-472c-ad67-7a194ee39b4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:40.695803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5698bf39-1734-4974-906a-aaaff0418ca5 admin admin] Received resource Port update without any changes: 045e8cb5-b097-4c96-a318-d42be89b2e6f {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:55:41.477459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['f0e20492-cd09-472c-ad67-7a194ee39b4a', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b'] and devices down [] completed. Oct 23 00:55:41.477785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:244 - ports processed. Elapsed:4.709 Oct 23 00:55:41.478116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:244 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:4.710 Oct 23 00:55:41.479437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Loop iteration exceeded interval (2 vs. 4.709588050842285)! {{(pid=105573) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 23 00:55:41.479722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:245 started Oct 23 00:55:41.482710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=553000000,duration_sec=502,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:41.483308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:41.484424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:245 - starting polling. Elapsed:0.004 Oct 23 00:55:41.486811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:41.492060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:245 - port information retrieved. Elapsed:0.012 Oct 23 00:55:41.492463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'added': {'1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd'}, 'removed': set(), 'updated': {'1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:41.493038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'mac_address': 'fa:16:3e:89:e0:2c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:41.493526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'mac_address': 'fa:16:3e:c5:d9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.144'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:41.493994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'mac_address': 'fa:16:3e:3b:d1:28', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.212'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:41.496670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 1af047de-df31-40f1-8ab4-6afa1a4ee2ae {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:41.511604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 1af047de-df31-40f1-8ab4-6afa1a4ee2ae updated. Details: {'device': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'mac_address': 'fa:16:3e:89:e0:2c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 23 00:55:41.512698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1af047de-df, col_values=(('tag', 4),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.513162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-1af047de-df, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.513600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-1af047de-df, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.533457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1af047de-df, col_values=(('other_config', {'net_uuid': 'af018619-0331-4553-bdbc-b12c91da85cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '354'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.554929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a6e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:41.555276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: f0e20492-cd09-472c-ad67-7a194ee39b4a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:41.555654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port f0e20492-cd09-472c-ad67-7a194ee39b4a updated. Details: {'device': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'mac_address': 'fa:16:3e:c5:d9:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.144'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:41.562489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f0e20492-cd, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.563001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-f0e20492-cd, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.563406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-f0e20492-cd, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.563862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:41.572282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-f0e20492-cd, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.578005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:41.589102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a70,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:41.591046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: c3d281d7-77bc-45d4-bfbc-c30a363df5dd {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:41.591388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port c3d281d7-77bc-45d4-bfbc-c30a363df5dd updated. Details: {'device': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'mac_address': 'fa:16:3e:3b:d1:28', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.212'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:41.597499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3d281d7-77, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.597986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c3d281d7-77, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.598427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c3d281d7-77, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.617717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3d281d7-77, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:41.641945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a72,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:41.645868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:245 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.150 Oct 23 00:55:41.646217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 2 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:55:41.646580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd'} Oct 23 00:55:41.654425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:41.654739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:41.676197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:41.767660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[454680b5-7588-4230-ab91-e876fff465d8]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:41.768299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:41.768598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:41.769802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:41.770083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:41.773682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:41.889193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11fbf26-0f3a-41e4-a227-eab0d5310964]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:41.890193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:245 - agent port security group processed in 0.397 Oct 23 00:55:41.891523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 1af047de-df31-40f1-8ab4-6afa1a4ee2ae to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:41.892036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for f0e20492-cd09-472c-ad67-7a194ee39b4a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:41.892546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for c3d281d7-77bc-45d4-bfbc-c30a363df5dd to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:41.945317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f59490ca-fa87-4925-84f7-7ed101d75060 None None] Resource Port 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:41.945859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f59490ca-fa87-4925-84f7-7ed101d75060 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:42.051141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b98ac330-83d5-4954-b95c-7100933b33aa None None] Resource Port c15a8bad-19fd-46da-8328-6797a742506a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=c15a8bad-19fd-46da-8328-6797a742506a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c15a8bad-19fd-46da-8328-6797a742506a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:42.052822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b98ac330-83d5-4954-b95c-7100933b33aa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c15a8bad-19fd-46da-8328-6797a742506a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:42.639575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b98ac330-83d5-4954-b95c-7100933b33aa None None] Resource Port c15a8bad-19fd-46da-8328-6797a742506a updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c15a8bad-19fd-46da-8328-6797a742506a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c15a8bad-19fd-46da-8328-6797a742506a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c15a8bad-19fd-46da-8328-6797a742506a,segment=NetworkSegment(63b58a73-ffd1-4018-ac3c-0db314c2c768),segment_id=63b58a73-ffd1-4018-ac3c-0db314c2c768)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:42.639953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b98ac330-83d5-4954-b95c-7100933b33aa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c15a8bad-19fd-46da-8328-6797a742506a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:42.964630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f59490ca-fa87-4925-84f7-7ed101d75060 None None] Resource Port 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a,segment=NetworkSegment(6c7f3988-5c29-4b49-bf43-a45d839e2e81),segment_id=6c7f3988-5c29-4b49-bf43-a45d839e2e81)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:42.965263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f59490ca-fa87-4925-84f7-7ed101d75060 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:43.553729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9e74908d-1a48-4693-b1e2-b9d5d40a36ad","insert","qr-c15a8bad-19",["set",[]],["map",[["attached-mac","fa:16:3e:86:80:f4"],["iface-id","c15a8bad-19fd-46da-8328-6797a742506a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:43.584709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9e74908d-1a48-4693-b1e2-b9d5d40a36ad","old",null,["set",[]],null],["","new","qr-c15a8bad-19",16,["map",[["attached-mac","fa:16:3e:86:80:f4"],["iface-id","c15a8bad-19fd-46da-8328-6797a742506a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:43.654771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 1af047de-df31-40f1-8ab4-6afa1a4ee2ae updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:43.655785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (1af047de-df31-40f1-8ab4-6afa1a4ee2ae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:43.712070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:43Z,description='tempest-description--2121747662',id=de7217fb-3148-4635-a766-93f8b6fd3faa,is_default=False,name='tempest-securitygroup--266028795',project_id='59add4b78cd346a194c4be211d1996be',revision_number=1,rules=[SecurityGroupRule(4bfe63a0-41a6-47cc-8cee-f74f9a553650),SecurityGroupRule(81b9d63a-35d4-4d42-bf5d-bdecd70d472c)],shared=False,stateful=True,updated_at=2022-10-23T00:55:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:43.712978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (de7217fb-3148-4635-a766-93f8b6fd3faa), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:43.713893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:43Z,description=,direction='egress',ethertype='IPv4',id=4bfe63a0-41a6-47cc-8cee-f74f9a553650,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de7217fb-3148-4635-a766-93f8b6fd3faa,updated_at=2022-10-23T00:55:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:43.715915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4bfe63a0-41a6-47cc-8cee-f74f9a553650), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:43.718866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 00:55:43.719844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:43Z,description=,direction='egress',ethertype='IPv6',id=81b9d63a-35d4-4d42-bf5d-bdecd70d472c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de7217fb-3148-4635-a766-93f8b6fd3faa,updated_at=2022-10-23T00:55:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:43.725362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (81b9d63a-35d4-4d42-bf5d-bdecd70d472c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:43.730626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6ab042ca-86f1-46d2-b310-2f7941e0ebff tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 00:55:43.972021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e6007c98-e7dd-452d-b055-d85b3cc17f76 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:43Z,description='',direction='ingress',ethertype='IPv4',id=eff17224-53e4-4cbc-a3ce-704b6a8dd48f,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='59add4b78cd346a194c4be211d1996be',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de7217fb-3148-4635-a766-93f8b6fd3faa,updated_at=2022-10-23T00:55:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:43.973311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e6007c98-e7dd-452d-b055-d85b3cc17f76 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (eff17224-53e4-4cbc-a3ce-704b6a8dd48f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:43.973800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e6007c98-e7dd-452d-b055-d85b3cc17f76 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 00:55:44.289802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eeac92c2-b842-471c-b8a8-7aa752228661 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:44Z,description='',direction='ingress',ethertype='IPv4',id=ea11ce43-6a10-4eeb-af76-7dc94282ebc1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de7217fb-3148-4635-a766-93f8b6fd3faa,updated_at=2022-10-23T00:55:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:44.290474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eeac92c2-b842-471c-b8a8-7aa752228661 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ea11ce43-6a10-4eeb-af76-7dc94282ebc1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:44.290953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eeac92c2-b842-471c-b8a8-7aa752228661 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 00:55:44.614122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:44Z,description='Default security group',id=e8556b27-778d-4531-8231-442ecebb1f7e,is_default=True,name='default',project_id='0a1881d617e647ab9b6f8c9bf1284dc8',revision_number=1,rules=[SecurityGroupRule(109884bc-5664-4c89-a713-8845fd981947),SecurityGroupRule(bba403b4-c1db-4a6a-8ca3-f3f03b031c5e),SecurityGroupRule(c8bd4255-1722-440b-a8ea-7eb7c0081aec),SecurityGroupRule(e76cd469-755b-49d6-b132-7140b376eb48)],shared=False,stateful=True,updated_at=2022-10-23T00:55:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:44.614495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (e8556b27-778d-4531-8231-442ecebb1f7e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:44.615275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:44Z,description=,direction='egress',ethertype='IPv6',id=109884bc-5664-4c89-a713-8845fd981947,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a1881d617e647ab9b6f8c9bf1284dc8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8556b27-778d-4531-8231-442ecebb1f7e,updated_at=2022-10-23T00:55:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:44.615782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (109884bc-5664-4c89-a713-8845fd981947), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:44.616253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:44.617411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:44Z,description=,direction='ingress',ethertype='IPv4',id=bba403b4-c1db-4a6a-8ca3-f3f03b031c5e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a1881d617e647ab9b6f8c9bf1284dc8',protocol=,remote_address_group_id=,remote_group_id=e8556b27-778d-4531-8231-442ecebb1f7e,remote_ip_prefix=,revision_number=0,security_group_id=e8556b27-778d-4531-8231-442ecebb1f7e,updated_at=2022-10-23T00:55:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:44.617846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (bba403b4-c1db-4a6a-8ca3-f3f03b031c5e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:44.618175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:44.618821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:44Z,description=,direction='egress',ethertype='IPv4',id=c8bd4255-1722-440b-a8ea-7eb7c0081aec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a1881d617e647ab9b6f8c9bf1284dc8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8556b27-778d-4531-8231-442ecebb1f7e,updated_at=2022-10-23T00:55:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:44.619165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c8bd4255-1722-440b-a8ea-7eb7c0081aec), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:44.619590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:44.620249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:44Z,description=,direction='ingress',ethertype='IPv6',id=e76cd469-755b-49d6-b132-7140b376eb48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a1881d617e647ab9b6f8c9bf1284dc8',protocol=,remote_address_group_id=,remote_group_id=e8556b27-778d-4531-8231-442ecebb1f7e,remote_ip_prefix=,revision_number=0,security_group_id=e8556b27-778d-4531-8231-442ecebb1f7e,updated_at=2022-10-23T00:55:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:44.620588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e76cd469-755b-49d6-b132-7140b376eb48), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:44.621087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22f8a38b-b90f-4803-ae40-8de8ffb54cee admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:45.479765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Resource SecurityGroup deleted: e8556b27-778d-4531-8231-442ecebb1f7e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:45.481080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (e8556b27-778d-4531-8231-442ecebb1f7e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:45.481721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e8556b27-778d-4531-8231-442ecebb1f7e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:45.587847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e8556b27-778d-4531-8231-442ecebb1f7e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:45.588308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Resource SecurityGroupRule deleted: 109884bc-5664-4c89-a713-8845fd981947 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:45.588672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (109884bc-5664-4c89-a713-8845fd981947), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:45.589027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:45.589521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Resource SecurityGroupRule deleted: bba403b4-c1db-4a6a-8ca3-f3f03b031c5e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:45.589867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (bba403b4-c1db-4a6a-8ca3-f3f03b031c5e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:45.590184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:45.590548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Resource SecurityGroupRule deleted: c8bd4255-1722-440b-a8ea-7eb7c0081aec {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:45.590880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c8bd4255-1722-440b-a8ea-7eb7c0081aec), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:45.591219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:45.591592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Resource SecurityGroupRule deleted: e76cd469-755b-49d6-b132-7140b376eb48 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:45.591922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e76cd469-755b-49d6-b132-7140b376eb48), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:45.592226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3071e84d-4ec1-4d19-bd6a-9f71c38b43d0 admin admin] Security group rule updated ['e8556b27-778d-4531-8231-442ecebb1f7e'] Oct 23 00:55:45.985715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd'] and devices down [] completed. Oct 23 00:55:45.986144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:245 - ports processed. Elapsed:4.506 Oct 23 00:55:45.986585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:245 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 3, 'removed': 0}}. Elapsed:4.507 Oct 23 00:55:45.987442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Loop iteration exceeded interval (2 vs. 4.506834506988525)! {{(pid=105573) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 23 00:55:45.988421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:246 started Oct 23 00:55:45.999480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=63000000,duration_sec=507,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:46.001461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:46.002074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:246 - starting polling. Elapsed:0.014 Oct 23 00:55:46.009866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:46.019879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:246 - port information retrieved. Elapsed:0.032 Oct 23 00:55:46.023202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c15a8bad-19fd-46da-8328-6797a742506a', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'added': {'c15a8bad-19fd-46da-8328-6797a742506a'}, 'removed': set(), 'updated': {'1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c15a8bad-19fd-46da-8328-6797a742506a', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:46.026201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'mac_address': 'fa:16:3e:89:e0:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:46.028008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'c15a8bad-19fd-46da-8328-6797a742506a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': 'c15a8bad-19fd-46da-8328-6797a742506a', 'mac_address': 'fa:16:3e:86:80:f4', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:46.030040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'mac_address': 'fa:16:3e:fd:54:c7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:46.043560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 1af047de-df31-40f1-8ab4-6afa1a4ee2ae {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:46.045060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 1af047de-df31-40f1-8ab4-6afa1a4ee2ae updated. Details: {'device': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'device_id': '2c238434-bfef-4fde-aac0-cae3ae6aa742', 'network_id': 'af018619-0331-4553-bdbc-b12c91da85cf', 'port_id': '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'mac_address': 'fa:16:3e:89:e0:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f0acb91-496c-45f4-acb5-584ff234a755', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 23 00:55:46.047254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1af047de-df, col_values=(('tag', 4),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.054537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-1af047de-df, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.055191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-1af047de-df, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.058145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:46.069917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1af047de-df, col_values=(('other_config', {'net_uuid': 'af018619-0331-4553-bdbc-b12c91da85cf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '354', 'tag': '4'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.075571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:46.106214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a76,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:46.111129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: c15a8bad-19fd-46da-8328-6797a742506a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:46.111807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port c15a8bad-19fd-46da-8328-6797a742506a updated. Details: {'device': 'c15a8bad-19fd-46da-8328-6797a742506a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': 'c15a8bad-19fd-46da-8328-6797a742506a', 'mac_address': 'fa:16:3e:86:80:f4', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 23 00:55:46.113241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c15a8bad-19, col_values=(('tag', 6),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.113897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c15a8bad-19, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.114722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c15a8bad-19, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.132275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c15a8bad-19, col_values=(('other_config', {'net_uuid': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '366'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.143879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a78,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:46.144605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:46.145317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a updated. Details: {'device': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'mac_address': 'fa:16:3e:fd:54:c7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 23 00:55:46.147143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9b1d8b2e-51, col_values=(('tag', 7),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.148961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-9b1d8b2e-51, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.149714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-9b1d8b2e-51, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.160252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9b1d8b2e-51, col_values=(('other_config', {'net_uuid': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '399'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:46.178746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a7a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:46.181654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:246 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.156 Oct 23 00:55:46.182271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:55:46.184220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'c15a8bad-19fd-46da-8328-6797a742506a'} Oct 23 00:55:46.187467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:46.188032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:46.200189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:46.214925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc073965-dee2-48bb-a878-26c7810c95f3 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:44Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ef9908ec-665e-42ab-9646-863c5d00d20a,mac_address=fa:16:3e:93:ea:18,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ef9908ec-665e-42ab-9646-863c5d00d20a),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T00:55:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:46.223343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc073965-dee2-48bb-a878-26c7810c95f3 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ef9908ec-665e-42ab-9646-863c5d00d20a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:46.290934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[1904aeff-2140-42c2-bc18-b5f98cabc871]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:46.292124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 2 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:46.292683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:46.298918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:46.299497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:46.312910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port c3d281d7-77bc-45d4-bfbc-c30a363df5dd updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c3d281d7-77bc-45d4-bfbc-c30a363df5dd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:46.313788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c3d281d7-77bc-45d4-bfbc-c30a363df5dd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:46.314928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:46.385499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91cfbd-0bec-4ae2-9173-0a627f29df29]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:46.386403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:246 - agent port security group processed in 0.361 Oct 23 00:55:46.388209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 1af047de-df31-40f1-8ab4-6afa1a4ee2ae to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:46.389191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for c15a8bad-19fd-46da-8328-6797a742506a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:46.389718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:46.807073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc073965-dee2-48bb-a878-26c7810c95f3 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource Port ef9908ec-665e-42ab-9646-863c5d00d20a updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'e2f5d415-36e0-41e4-b3d8-7da325513e94'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:46.809517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc073965-dee2-48bb-a878-26c7810c95f3 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ef9908ec-665e-42ab-9646-863c5d00d20a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:47.160483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ac3ae20-17c9-4b11-b335-23dca3c360cc None None] Resource Port 045e8cb5-b097-4c96-a318-d42be89b2e6f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=045e8cb5-b097-4c96-a318-d42be89b2e6f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=045e8cb5-b097-4c96-a318-d42be89b2e6f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:47.160483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ac3ae20-17c9-4b11-b335-23dca3c360cc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (045e8cb5-b097-4c96-a318-d42be89b2e6f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:47.192449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:46Z,description='Default security group',id=2d8b76de-9883-45cd-95b4-7f955b06b617,is_default=True,name='default',project_id='e8eb62cedabe4347bc14d53d68f342e9',revision_number=1,rules=[SecurityGroupRule(3188cefa-7eca-4436-ab4f-0cddda3aff53),SecurityGroupRule(383d5bfd-a68c-4dab-bc67-40f48142d51c),SecurityGroupRule(9c34c156-550b-43b2-8235-d064340ec674),SecurityGroupRule(b9d7794d-618b-4e45-8751-3f440f470740)],shared=False,stateful=True,updated_at=2022-10-23T00:55:46Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:47.193045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (2d8b76de-9883-45cd-95b4-7f955b06b617), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:47.193686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:47Z,description=,direction='ingress',ethertype='IPv6',id=3188cefa-7eca-4436-ab4f-0cddda3aff53,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8eb62cedabe4347bc14d53d68f342e9',protocol=,remote_address_group_id=,remote_group_id=2d8b76de-9883-45cd-95b4-7f955b06b617,remote_ip_prefix=,revision_number=0,security_group_id=2d8b76de-9883-45cd-95b4-7f955b06b617,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:47.194525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3188cefa-7eca-4436-ab4f-0cddda3aff53), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:47.194869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:47.195570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:47Z,description=,direction='egress',ethertype='IPv4',id=383d5bfd-a68c-4dab-bc67-40f48142d51c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8eb62cedabe4347bc14d53d68f342e9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2d8b76de-9883-45cd-95b4-7f955b06b617,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:47.195932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (383d5bfd-a68c-4dab-bc67-40f48142d51c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:47.196261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:47.197563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:46Z,description=,direction='ingress',ethertype='IPv4',id=9c34c156-550b-43b2-8235-d064340ec674,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8eb62cedabe4347bc14d53d68f342e9',protocol=,remote_address_group_id=,remote_group_id=2d8b76de-9883-45cd-95b4-7f955b06b617,remote_ip_prefix=,revision_number=0,security_group_id=2d8b76de-9883-45cd-95b4-7f955b06b617,updated_at=2022-10-23T00:55:46Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:47.197929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9c34c156-550b-43b2-8235-d064340ec674), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:47.198258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:47.198919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:47Z,description=,direction='egress',ethertype='IPv6',id=b9d7794d-618b-4e45-8751-3f440f470740,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8eb62cedabe4347bc14d53d68f342e9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2d8b76de-9883-45cd-95b4-7f955b06b617,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:47.203807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b9d7794d-618b-4e45-8751-3f440f470740), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:47.206988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b3c61e64-87a3-48dc-9ae7-e462daf6863d admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:48.134234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:47Z,description='Default security group',id=3403f1e6-47d2-41a6-a699-c833f1d53eed,is_default=True,name='default',project_id='bb62c08b1427475daec1a09ab9377b93',revision_number=1,rules=[SecurityGroupRule(336eca71-18aa-45ff-822e-c7e0af77d775),SecurityGroupRule(3a4b385a-f4c3-460c-842d-cae2fd1331ab),SecurityGroupRule(8c3a9121-c296-41d9-9118-e2e4d091f7e7),SecurityGroupRule(9bc79b86-aafe-4b77-b6da-b1446e2fb3f4)],shared=False,stateful=True,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:48.135784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (3403f1e6-47d2-41a6-a699-c833f1d53eed), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.136967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:47Z,description=,direction='egress',ethertype='IPv6',id=336eca71-18aa-45ff-822e-c7e0af77d775,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb62c08b1427475daec1a09ab9377b93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3403f1e6-47d2-41a6-a699-c833f1d53eed,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:48.137330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (336eca71-18aa-45ff-822e-c7e0af77d775), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.137656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:48.138701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:47Z,description=,direction='egress',ethertype='IPv4',id=3a4b385a-f4c3-460c-842d-cae2fd1331ab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb62c08b1427475daec1a09ab9377b93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3403f1e6-47d2-41a6-a699-c833f1d53eed,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:48.139329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3a4b385a-f4c3-460c-842d-cae2fd1331ab), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.139792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:48.142541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:47Z,description=,direction='ingress',ethertype='IPv4',id=8c3a9121-c296-41d9-9118-e2e4d091f7e7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb62c08b1427475daec1a09ab9377b93',protocol=,remote_address_group_id=,remote_group_id=3403f1e6-47d2-41a6-a699-c833f1d53eed,remote_ip_prefix=,revision_number=0,security_group_id=3403f1e6-47d2-41a6-a699-c833f1d53eed,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:48.143703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8c3a9121-c296-41d9-9118-e2e4d091f7e7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.145509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:48.147366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:47Z,description=,direction='ingress',ethertype='IPv6',id=9bc79b86-aafe-4b77-b6da-b1446e2fb3f4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb62c08b1427475daec1a09ab9377b93',protocol=,remote_address_group_id=,remote_group_id=3403f1e6-47d2-41a6-a699-c833f1d53eed,remote_ip_prefix=,revision_number=0,security_group_id=3403f1e6-47d2-41a6-a699-c833f1d53eed,updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:48.150166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9bc79b86-aafe-4b77-b6da-b1446e2fb3f4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.153796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9ca10e-f72d-450b-b765-c3de4f09ef31 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:48.355160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Resource SecurityGroup deleted: 2d8b76de-9883-45cd-95b4-7f955b06b617 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.355541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (2d8b76de-9883-45cd-95b4-7f955b06b617), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.356256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2d8b76de-9883-45cd-95b4-7f955b06b617',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:48.477366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2d8b76de-9883-45cd-95b4-7f955b06b617',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:48.478296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Resource SecurityGroupRule deleted: 3188cefa-7eca-4436-ab4f-0cddda3aff53 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.478878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3188cefa-7eca-4436-ab4f-0cddda3aff53), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.479434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:48.480035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Resource SecurityGroupRule deleted: 383d5bfd-a68c-4dab-bc67-40f48142d51c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.480584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (383d5bfd-a68c-4dab-bc67-40f48142d51c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.481128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:48.481698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Resource SecurityGroupRule deleted: 9c34c156-550b-43b2-8235-d064340ec674 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.482257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9c34c156-550b-43b2-8235-d064340ec674), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.482798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:48.483361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Resource SecurityGroupRule deleted: b9d7794d-618b-4e45-8751-3f440f470740 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.484013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b9d7794d-618b-4e45-8751-3f440f470740), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.484842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f5873210-ea53-4470-aa53-44d781fc67e7 admin admin] Security group rule updated ['2d8b76de-9883-45cd-95b4-7f955b06b617'] Oct 23 00:55:48.506246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Resource SecurityGroup deleted: 3403f1e6-47d2-41a6-a699-c833f1d53eed {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.507052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (3403f1e6-47d2-41a6-a699-c833f1d53eed), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.507911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3403f1e6-47d2-41a6-a699-c833f1d53eed',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:48.623266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port c15a8bad-19fd-46da-8328-6797a742506a updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:48.624070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c15a8bad-19fd-46da-8328-6797a742506a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.662645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3403f1e6-47d2-41a6-a699-c833f1d53eed',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:48.663798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Resource SecurityGroupRule deleted: 336eca71-18aa-45ff-822e-c7e0af77d775 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.664451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (336eca71-18aa-45ff-822e-c7e0af77d775), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.665134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:48.665739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Resource SecurityGroupRule deleted: 3a4b385a-f4c3-460c-842d-cae2fd1331ab {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.666289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3a4b385a-f4c3-460c-842d-cae2fd1331ab), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.666818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:48.667400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Resource SecurityGroupRule deleted: 8c3a9121-c296-41d9-9118-e2e4d091f7e7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.667947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8c3a9121-c296-41d9-9118-e2e4d091f7e7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.668470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:48.669114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Resource SecurityGroupRule deleted: 9bc79b86-aafe-4b77-b6da-b1446e2fb3f4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:48.669747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9bc79b86-aafe-4b77-b6da-b1446e2fb3f4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:48.670336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b7edc69-620f-4f72-85a8-f88fd129e336 admin admin] Security group rule updated ['3403f1e6-47d2-41a6-a699-c833f1d53eed'] Oct 23 00:55:49.026819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ac3ae20-17c9-4b11-b335-23dca3c360cc None None] Resource Port 045e8cb5-b097-4c96-a318-d42be89b2e6f updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=045e8cb5-b097-4c96-a318-d42be89b2e6f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=045e8cb5-b097-4c96-a318-d42be89b2e6f,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=045e8cb5-b097-4c96-a318-d42be89b2e6f,segment=NetworkSegment(7dc83201-cb39-4cd2-9302-c1b785eda914),segment_id=7dc83201-cb39-4cd2-9302-c1b785eda914)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:49.027521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ac3ae20-17c9-4b11-b335-23dca3c360cc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (045e8cb5-b097-4c96-a318-d42be89b2e6f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:49.762742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-605daf8c-5edf-4e37-99f9-a670116472de tempest-DeleteServersTestJSON-44257626 tempest-DeleteServersTestJSON-44257626-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:45Z,data_plane_status=None,description='',device_id='81a81607-ef2d-4305-9f21-d24f821e2546',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=eaf96dfe-f805-4be4-9d2f-7507301823d2,mac_address=fa:16:3e:43:87:0f,name='',network_id=af018619-0331-4553-bdbc-b12c91da85cf,numa_affinity_policy=,project_id='29c3589cf3024c1083bc90f33ab61c00',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(eaf96dfe-f805-4be4-9d2f-7507301823d2),security_group_ids=set([f3ce37d9-177c-4e87-927f-4bd88426ffae]),status='DOWN',updated_at=2022-10-23T00:55:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:49.764033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-605daf8c-5edf-4e37-99f9-a670116472de tempest-DeleteServersTestJSON-44257626 tempest-DeleteServersTestJSON-44257626-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (eaf96dfe-f805-4be4-9d2f-7507301823d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:49.765665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-605daf8c-5edf-4e37-99f9-a670116472de tempest-DeleteServersTestJSON-44257626 tempest-DeleteServersTestJSON-44257626-project] Security group member updated {'f3ce37d9-177c-4e87-927f-4bd88426ffae'} Oct 23 00:55:49.818696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c15a8bad-19fd-46da-8328-6797a742506a', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'] and devices down [] completed. Oct 23 00:55:49.819198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:246 - ports processed. Elapsed:3.831 Oct 23 00:55:49.819604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:246 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:3.832 Oct 23 00:55:49.820504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Loop iteration exceeded interval (2 vs. 3.831791639328003)! {{(pid=105573) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 23 00:55:49.821034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:247 started Oct 23 00:55:49.824288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=894000000,duration_sec=510,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:49.825145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:49.825608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:247 - starting polling. Elapsed:0.005 Oct 23 00:55:49.835941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:49.845223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:247 - port information retrieved. Elapsed:0.024 Oct 23 00:55:49.848886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c15a8bad-19fd-46da-8328-6797a742506a', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'added': set(), 'removed': set(), 'updated': {'c15a8bad-19fd-46da-8328-6797a742506a', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:49.851530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'c15a8bad-19fd-46da-8328-6797a742506a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': 'c15a8bad-19fd-46da-8328-6797a742506a', 'mac_address': 'fa:16:3e:86:80:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:49.852814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'mac_address': 'fa:16:3e:3b:d1:28', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.212'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:49.863401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: c15a8bad-19fd-46da-8328-6797a742506a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:49.865542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port c15a8bad-19fd-46da-8328-6797a742506a updated. Details: {'device': 'c15a8bad-19fd-46da-8328-6797a742506a', 'device_id': '2d77609f-f6a2-4b66-94b2-dbd18b570cb6', 'network_id': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'port_id': 'c15a8bad-19fd-46da-8328-6797a742506a', 'mac_address': 'fa:16:3e:86:80:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b567fc0e-81bb-4e4e-8bd3-a17fd2562f11', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 23 00:55:49.889302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c15a8bad-19, col_values=(('tag', 6),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.894199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c15a8bad-19, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.898494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c15a8bad-19, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.908775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:49.924388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c15a8bad-19, col_values=(('other_config', {'net_uuid': '1d27b6d9-fef6-49cb-833f-13cb9578958e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '366', 'tag': '6'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.939074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:49.947752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a7e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:49.949525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: c3d281d7-77bc-45d4-bfbc-c30a363df5dd {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:49.953639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port c3d281d7-77bc-45d4-bfbc-c30a363df5dd updated. Details: {'device': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', 'mac_address': 'fa:16:3e:3b:d1:28', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.212'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:55:49.956864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3d281d7-77, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.958729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c3d281d7-77, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.959452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c3d281d7-77, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.960072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:49.966539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3d281d7-77, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:49.971021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:49.979950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a80,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:49.981125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:247 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.132 Oct 23 00:55:49.981702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 2 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:49.983289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:49.990636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:49.991225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:50.018665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:50.063932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:55:49Z,description='Default security group',id=6f1bb7b1-b072-4cf2-abfa-99a57a171572,is_default=True,name='default',project_id='2ff8ecd13bb24c2a838797ac0bf204ef',revision_number=1,rules=[SecurityGroupRule(09216255-bc8b-4429-ade6-334968f20a18),SecurityGroupRule(5877eaea-a142-41ef-ae9d-68a66d845d7a),SecurityGroupRule(ac497d32-924e-4272-9680-eca5a4f9f99d),SecurityGroupRule(e616b6d7-76dd-4e8b-b7e7-30ae4ffd62d2)],shared=False,stateful=True,updated_at=2022-10-23T00:55:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:50.064310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (6f1bb7b1-b072-4cf2-abfa-99a57a171572), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.065008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:49Z,description=,direction='ingress',ethertype='IPv6',id=09216255-bc8b-4429-ade6-334968f20a18,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff8ecd13bb24c2a838797ac0bf204ef',protocol=,remote_address_group_id=,remote_group_id=6f1bb7b1-b072-4cf2-abfa-99a57a171572,remote_ip_prefix=,revision_number=0,security_group_id=6f1bb7b1-b072-4cf2-abfa-99a57a171572,updated_at=2022-10-23T00:55:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:50.065366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (09216255-bc8b-4429-ade6-334968f20a18), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.065695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:50.188543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d7375-d8bd-4f85-aeb0-99408ea4de36]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:50.189516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:247 - agent port security group processed in 0.340 Oct 23 00:55:50.190268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for c15a8bad-19fd-46da-8328-6797a742506a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:50.190630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for c3d281d7-77bc-45d4-bfbc-c30a363df5dd to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:50.192635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:49Z,description=,direction='egress',ethertype='IPv6',id=5877eaea-a142-41ef-ae9d-68a66d845d7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff8ecd13bb24c2a838797ac0bf204ef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f1bb7b1-b072-4cf2-abfa-99a57a171572,updated_at=2022-10-23T00:55:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:50.193095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5877eaea-a142-41ef-ae9d-68a66d845d7a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.193487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:50.194215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:49Z,description=,direction='ingress',ethertype='IPv4',id=ac497d32-924e-4272-9680-eca5a4f9f99d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff8ecd13bb24c2a838797ac0bf204ef',protocol=,remote_address_group_id=,remote_group_id=6f1bb7b1-b072-4cf2-abfa-99a57a171572,remote_ip_prefix=,revision_number=0,security_group_id=6f1bb7b1-b072-4cf2-abfa-99a57a171572,updated_at=2022-10-23T00:55:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:50.194627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ac497d32-924e-4272-9680-eca5a4f9f99d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.195026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:50.196159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:55:49Z,description=,direction='egress',ethertype='IPv4',id=e616b6d7-76dd-4e8b-b7e7-30ae4ffd62d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff8ecd13bb24c2a838797ac0bf204ef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f1bb7b1-b072-4cf2-abfa-99a57a171572,updated_at=2022-10-23T00:55:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:50.196159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e616b6d7-76dd-4e8b-b7e7-30ae4ffd62d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.196636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ba9f83d1-48cd-49c2-9f58-00206a1f3b09 admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:50.310091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:50.310566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.398813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["065222bb-b9ac-4ac2-9250-9fb83da270da","insert","qr-045e8cb5-b0",["set",[]],["map",[["attached-mac","fa:16:3e:8e:5e:9a"],["iface-id","045e8cb5-b097-4c96-a318-d42be89b2e6f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:50.406203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["065222bb-b9ac-4ac2-9250-9fb83da270da","old",null,["set",[]],null],["","new","qr-045e8cb5-b0",17,["map",[["attached-mac","fa:16:3e:8e:5e:9a"],["iface-id","045e8cb5-b097-4c96-a318-d42be89b2e6f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:55:50.680112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Resource SecurityGroup deleted: 6f1bb7b1-b072-4cf2-abfa-99a57a171572 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:50.681379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (6f1bb7b1-b072-4cf2-abfa-99a57a171572), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.681379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6f1bb7b1-b072-4cf2-abfa-99a57a171572',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:55:50.876664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6f1bb7b1-b072-4cf2-abfa-99a57a171572',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:55:50.877602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Resource SecurityGroupRule deleted: 09216255-bc8b-4429-ade6-334968f20a18 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:50.877602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (09216255-bc8b-4429-ade6-334968f20a18), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.877803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:50.878406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Resource SecurityGroupRule deleted: 5877eaea-a142-41ef-ae9d-68a66d845d7a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:50.878879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5877eaea-a142-41ef-ae9d-68a66d845d7a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.880058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:50.880305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Resource SecurityGroupRule deleted: ac497d32-924e-4272-9680-eca5a4f9f99d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:50.880646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ac497d32-924e-4272-9680-eca5a4f9f99d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.880980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:50.881347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Resource SecurityGroupRule deleted: e616b6d7-76dd-4e8b-b7e7-30ae4ffd62d2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:55:50.881680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e616b6d7-76dd-4e8b-b7e7-30ae4ffd62d2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:50.881986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a693919-8b12-4cd1-8c6e-5be753d5614c admin admin] Security group rule updated ['6f1bb7b1-b072-4cf2-abfa-99a57a171572'] Oct 23 00:55:51.529024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['c15a8bad-19fd-46da-8328-6797a742506a', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd'] and devices down [] completed. Oct 23 00:55:51.530419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:247 - ports processed. Elapsed:1.708 Oct 23 00:55:51.530992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:247 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:1.710 Oct 23 00:55:51.821959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:248 started Oct 23 00:55:51.825867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=896000000,duration_sec=512,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:51.826760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:51.827450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:248 - starting polling. Elapsed:0.006 Oct 23 00:55:51.830500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:51.835762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:248 - port information retrieved. Elapsed:0.014 Oct 23 00:55:51.836960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '02ea638b-e76a-43d4-a7af-3b5be374e752', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c15a8bad-19fd-46da-8328-6797a742506a', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '81a4888a-a035-4442-91ea-dd123a7c1c39', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'added': {'045e8cb5-b097-4c96-a318-d42be89b2e6f'}, 'removed': set(), 'updated': {'9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:51.838283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'mac_address': 'fa:16:3e:8e:5e:9a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:51.838990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'mac_address': 'fa:16:3e:fd:54:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:51.844877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 045e8cb5-b097-4c96-a318-d42be89b2e6f {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:51.845527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 045e8cb5-b097-4c96-a318-d42be89b2e6f updated. Details: {'device': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'mac_address': 'fa:16:3e:8e:5e:9a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 23 00:55:51.846937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-045e8cb5-b0, col_values=(('tag', 5),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.847561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-045e8cb5-b0, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.848298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-045e8cb5-b0, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.858108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-045e8cb5-b0, col_values=(('other_config', {'net_uuid': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '356'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.907780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a84,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:51.909352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:51.910837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a updated. Details: {'device': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'device_id': 'fdd0b971-41e7-4c06-aca2-3799f3e76e98', 'network_id': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'port_id': '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', 'mac_address': 'fa:16:3e:fd:54:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'bdebfcdc-6951-4fee-aa37-29ecb806813d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 23 00:55:51.911988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9b1d8b2e-51, col_values=(('tag', 7),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.914267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-9b1d8b2e-51, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.915610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-9b1d8b2e-51, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.916081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:51.916931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9b1d8b2e-51, col_values=(('other_config', {'net_uuid': '6e24fc8d-42d5-4d11-b06b-37a4738231b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '399', 'tag': '7'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:51.917616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:51.931545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a86,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:51.931906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:248 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.094 Oct 23 00:55:51.932288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:55:51.932577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'045e8cb5-b097-4c96-a318-d42be89b2e6f'} Oct 23 00:55:51.933761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:51.934045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:51.943044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:52.009010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b0386-dda1-45a2-9e4f-fc1e86b4e21b]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:52.009778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:52.010487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:52.011739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:52.012094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:52.016770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:52.093119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5084781-8269-43df-a36c-ce298559e47f]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:52.094148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:248 - agent port security group processed in 0.256 Oct 23 00:55:52.095052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 045e8cb5-b097-4c96-a318-d42be89b2e6f to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:52.095352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:52.534886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 045e8cb5-b097-4c96-a318-d42be89b2e6f updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:52.535304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (045e8cb5-b097-4c96-a318-d42be89b2e6f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:52.606953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a72ed165-cd48-44c2-ab50-2e5eaead3198 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:47Z,data_plane_status=None,description='',device_id='15bcbe46-c80c-46d8-987e-3b270f8af3bc',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=16ac40d6-7a56-4def-a9f5-e0a3fade7563,mac_address=fa:16:3e:e2:25:b7,name='',network_id=6e24fc8d-42d5-4d11-b06b-37a4738231b0,numa_affinity_policy=,project_id='2a9697845193443ea394c1b480b6b769',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(16ac40d6-7a56-4def-a9f5-e0a3fade7563),security_group_ids=set([eab29425-121c-4f20-9db4-0aad6675d57d]),status='DOWN',updated_at=2022-10-23T00:55:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:52.607579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a72ed165-cd48-44c2-ab50-2e5eaead3198 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (16ac40d6-7a56-4def-a9f5-e0a3fade7563), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:52.608473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a72ed165-cd48-44c2-ab50-2e5eaead3198 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group member updated {'eab29425-121c-4f20-9db4-0aad6675d57d'} Oct 23 00:55:52.694261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['045e8cb5-b097-4c96-a318-d42be89b2e6f', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'] and devices down [] completed. Oct 23 00:55:52.694894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:248 - ports processed. Elapsed:0.873 Oct 23 00:55:52.695436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:248 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.874 Oct 23 00:55:53.417111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7c08071f-b016-44e9-81a8-32386c99d9f8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:55:50Z,data_plane_status=None,description='',device_id='435f22ac-20bf-48b6-b42c-62ecd7cf29f3',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fdd89988-ac0b-48a6-9a93-d8efc80c0957,mac_address=fa:16:3e:46:fe:67,name='',network_id=1d27b6d9-fef6-49cb-833f-13cb9578958e,numa_affinity_policy=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fdd89988-ac0b-48a6-9a93-d8efc80c0957),security_group_ids=set([b1d06491-a7a6-44ee-b7c2-32677dbd87bd]),status='DOWN',updated_at=2022-10-23T00:55:51Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:55:53.417743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7c08071f-b016-44e9-81a8-32386c99d9f8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fdd89988-ac0b-48a6-9a93-d8efc80c0957), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:53.418244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7c08071f-b016-44e9-81a8-32386c99d9f8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group member updated {'b1d06491-a7a6-44ee-b7c2-32677dbd87bd'} Oct 23 00:55:53.692706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3c47d406-839c-4661-b398-ba9fee21233a service neutron] Resource Port eaf96dfe-f805-4be4-9d2f-7507301823d2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=eaf96dfe-f805-4be4-9d2f-7507301823d2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=eaf96dfe-f805-4be4-9d2f-7507301823d2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:53.693384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3c47d406-839c-4661-b398-ba9fee21233a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (eaf96dfe-f805-4be4-9d2f-7507301823d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:53.823444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:249 started Oct 23 00:55:53.828215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=898000000,duration_sec=514,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:53.829189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:53.829616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:249 - starting polling. Elapsed:0.007 Oct 23 00:55:53.832554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:53.837265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:249 - port information retrieved. Elapsed:0.014 Oct 23 00:55:53.838038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39'}, 'added': set(), 'removed': set(), 'updated': {'045e8cb5-b097-4c96-a318-d42be89b2e6f'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:55:53.838937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'mac_address': 'fa:16:3e:8e:5e:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:55:53.845182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 045e8cb5-b097-4c96-a318-d42be89b2e6f {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:55:53.845651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 045e8cb5-b097-4c96-a318-d42be89b2e6f updated. Details: {'device': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'device_id': 'b19da5af-947c-410a-bc2b-a0b1941e7211', 'network_id': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'port_id': '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'mac_address': 'fa:16:3e:8e:5e:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '52944cd4-669b-4a10-a076-1661bc94a4a7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 23 00:55:53.847945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-045e8cb5-b0, col_values=(('tag', 5),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:53.848423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-045e8cb5-b0, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:53.848834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-045e8cb5-b0, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:53.849902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:53.850696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-045e8cb5-b0, col_values=(('other_config', {'net_uuid': 'f8105e98-346f-4369-be4d-2cb2d399c07a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '356', 'tag': '5'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:55:53.851636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:55:53.868261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2a8a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:53.870623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:249 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.030 Oct 23 00:55:53.871316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:55:53.873200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:55:53.876064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:55:53.878194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:55:53.890299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:55:53.998962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2774a5-02c1-499c-bfc3-48438243c4c9]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:55:54.000258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:249 - agent port security group processed in 0.161 Oct 23 00:55:54.001368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 045e8cb5-b097-4c96-a318-d42be89b2e6f to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:55:54.238532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['045e8cb5-b097-4c96-a318-d42be89b2e6f'] and devices down [] completed. Oct 23 00:55:54.238857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:249 - ports processed. Elapsed:0.416 Oct 23 00:55:54.239199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:249 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.417 Oct 23 00:55:54.591144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3c47d406-839c-4661-b398-ba9fee21233a service neutron] Resource Port eaf96dfe-f805-4be4-9d2f-7507301823d2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=eaf96dfe-f805-4be4-9d2f-7507301823d2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=eaf96dfe-f805-4be4-9d2f-7507301823d2,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=eaf96dfe-f805-4be4-9d2f-7507301823d2,segment=NetworkSegment(b638209f-90ba-44ee-80d1-50cdacceb6dc),segment_id=b638209f-90ba-44ee-80d1-50cdacceb6dc)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:55:54.591842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3c47d406-839c-4661-b398-ba9fee21233a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (eaf96dfe-f805-4be4-9d2f-7507301823d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:55.824283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:250 started Oct 23 00:55:55.830727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=900000000,duration_sec=516,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:55.831428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:55.831716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:250 - starting polling. Elapsed:0.008 Oct 23 00:55:55.834186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:55:55.837510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:250 - port information retrieved. Elapsed:0.013 Oct 23 00:55:55.849679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:250 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.025 Oct 23 00:55:57.825818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:251 started Oct 23 00:55:57.835402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=905000000,duration_sec=518,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:57.836305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:57.836824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:251 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 00:55:59.827337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:252 started Oct 23 00:55:59.830162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=901000000,duration_sec=520,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:55:59.830822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:55:59.831234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:252 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:56:01.828164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:253 started Oct 23 00:56:01.832541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=903000000,duration_sec=522,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:01.833420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:01.833779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:253 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:56:02.635668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8c47cc11-55ac-482c-a52d-d26f443e5e62 service neutron] Resource Port 16ac40d6-7a56-4def-a9f5-e0a3fade7563 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=16ac40d6-7a56-4def-a9f5-e0a3fade7563,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=16ac40d6-7a56-4def-a9f5-e0a3fade7563,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:02.636103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8c47cc11-55ac-482c-a52d-d26f443e5e62 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (16ac40d6-7a56-4def-a9f5-e0a3fade7563), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:02.908281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358789da-65ec-4cf0-8529-c0a383fa6eb8 service neutron] Resource Port fdd89988-ac0b-48a6-9a93-d8efc80c0957 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=fdd89988-ac0b-48a6-9a93-d8efc80c0957,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=fdd89988-ac0b-48a6-9a93-d8efc80c0957,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:02.908928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-358789da-65ec-4cf0-8529-c0a383fa6eb8 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fdd89988-ac0b-48a6-9a93-d8efc80c0957), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:03.298915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8c47cc11-55ac-482c-a52d-d26f443e5e62 service neutron] Resource Port 16ac40d6-7a56-4def-a9f5-e0a3fade7563 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=16ac40d6-7a56-4def-a9f5-e0a3fade7563,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=16ac40d6-7a56-4def-a9f5-e0a3fade7563,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=16ac40d6-7a56-4def-a9f5-e0a3fade7563,segment=NetworkSegment(6c7f3988-5c29-4b49-bf43-a45d839e2e81),segment_id=6c7f3988-5c29-4b49-bf43-a45d839e2e81)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:03.299301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8c47cc11-55ac-482c-a52d-d26f443e5e62 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (16ac40d6-7a56-4def-a9f5-e0a3fade7563), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:03.487441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358789da-65ec-4cf0-8529-c0a383fa6eb8 service neutron] Resource Port fdd89988-ac0b-48a6-9a93-d8efc80c0957 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=fdd89988-ac0b-48a6-9a93-d8efc80c0957,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=fdd89988-ac0b-48a6-9a93-d8efc80c0957,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=fdd89988-ac0b-48a6-9a93-d8efc80c0957,segment=NetworkSegment(63b58a73-ffd1-4018-ac3c-0db314c2c768),segment_id=63b58a73-ffd1-4018-ac3c-0db314c2c768)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:03.487822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-358789da-65ec-4cf0-8529-c0a383fa6eb8 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fdd89988-ac0b-48a6-9a93-d8efc80c0957), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:03.829478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:254 started Oct 23 00:56:03.833319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=903000000,duration_sec=524,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:03.834301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:03.834815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:254 - starting polling. Elapsed:0.006 Oct 23 00:56:03.838797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:03.843846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:254 - port information retrieved. Elapsed:0.015 Oct 23 00:56:03.844446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:254 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 23 00:56:05.831010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:255 started Oct 23 00:56:05.835123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=906000000,duration_sec=526,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:05.836994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:05.838456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:255 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 00:56:06.759267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:06Z,description='Default security group',id=48d3ba92-d222-4aac-8718-805dc9a8db97,is_default=True,name='default',project_id='24cf47f2b4e549e09d3c7f2e1260d5a9',revision_number=1,rules=[SecurityGroupRule(0e150060-ce19-4a37-8239-d6193813909d),SecurityGroupRule(110b78fe-443d-4bfd-ad00-927705e676ae),SecurityGroupRule(641317d5-5839-44d7-87e7-d240dea15863),SecurityGroupRule(94340292-e69c-4aa7-86ab-7cd78834f4a2)],shared=False,stateful=True,updated_at=2022-10-23T00:56:06Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:06.759650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (48d3ba92-d222-4aac-8718-805dc9a8db97), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.760843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:06Z,description=,direction='egress',ethertype='IPv6',id=0e150060-ce19-4a37-8239-d6193813909d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24cf47f2b4e549e09d3c7f2e1260d5a9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48d3ba92-d222-4aac-8718-805dc9a8db97,updated_at=2022-10-23T00:56:06Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:06.761348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0e150060-ce19-4a37-8239-d6193813909d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.761850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:06.762847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:06Z,description=,direction='ingress',ethertype='IPv4',id=110b78fe-443d-4bfd-ad00-927705e676ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24cf47f2b4e549e09d3c7f2e1260d5a9',protocol=,remote_address_group_id=,remote_group_id=48d3ba92-d222-4aac-8718-805dc9a8db97,remote_ip_prefix=,revision_number=0,security_group_id=48d3ba92-d222-4aac-8718-805dc9a8db97,updated_at=2022-10-23T00:56:06Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:06.763360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (110b78fe-443d-4bfd-ad00-927705e676ae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.763983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:06.769717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:06Z,description=,direction='ingress',ethertype='IPv6',id=641317d5-5839-44d7-87e7-d240dea15863,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24cf47f2b4e549e09d3c7f2e1260d5a9',protocol=,remote_address_group_id=,remote_group_id=48d3ba92-d222-4aac-8718-805dc9a8db97,remote_ip_prefix=,revision_number=0,security_group_id=48d3ba92-d222-4aac-8718-805dc9a8db97,updated_at=2022-10-23T00:56:06Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:06.770367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (641317d5-5839-44d7-87e7-d240dea15863), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.770873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:06.772220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:06Z,description=,direction='egress',ethertype='IPv4',id=94340292-e69c-4aa7-86ab-7cd78834f4a2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24cf47f2b4e549e09d3c7f2e1260d5a9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48d3ba92-d222-4aac-8718-805dc9a8db97,updated_at=2022-10-23T00:56:06Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:06.772807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (94340292-e69c-4aa7-86ab-7cd78834f4a2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.773943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0c54531b-32f3-4183-bd85-8c335e5fa3c5 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:06.873208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8fe50200-1044-458f-8b6c-9e922e7a6223 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:06Z,data_plane_status=None,description='',device_id='46df2e4a-d66e-402e-ba21-e1d245b92663',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=070636ae-227f-400c-a9d9-cd7af698e161,mac_address=fa:16:3e:2c:ee:09,name='',network_id=1d27b6d9-fef6-49cb-833f-13cb9578958e,numa_affinity_policy=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(070636ae-227f-400c-a9d9-cd7af698e161),security_group_ids=set([b1d06491-a7a6-44ee-b7c2-32677dbd87bd]),status='DOWN',updated_at=2022-10-23T00:56:06Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:06.874712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8fe50200-1044-458f-8b6c-9e922e7a6223 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (070636ae-227f-400c-a9d9-cd7af698e161), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.875445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8fe50200-1044-458f-8b6c-9e922e7a6223 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group member updated {'b1d06491-a7a6-44ee-b7c2-32677dbd87bd'} Oct 23 00:56:06.980060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Resource SecurityGroup deleted: 48d3ba92-d222-4aac-8718-805dc9a8db97 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:06.980438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (48d3ba92-d222-4aac-8718-805dc9a8db97), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.980923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('48d3ba92-d222-4aac-8718-805dc9a8db97',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:06.995146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('48d3ba92-d222-4aac-8718-805dc9a8db97',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:06.995767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Resource SecurityGroupRule deleted: 0e150060-ce19-4a37-8239-d6193813909d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:06.996139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0e150060-ce19-4a37-8239-d6193813909d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.996473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:06.997041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Resource SecurityGroupRule deleted: 110b78fe-443d-4bfd-ad00-927705e676ae {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:06.997450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (110b78fe-443d-4bfd-ad00-927705e676ae), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.997686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:06.998049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Resource SecurityGroupRule deleted: 641317d5-5839-44d7-87e7-d240dea15863 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:06.998538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (641317d5-5839-44d7-87e7-d240dea15863), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.998846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:06.999214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Resource SecurityGroupRule deleted: 94340292-e69c-4aa7-86ab-7cd78834f4a2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:06.999550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (94340292-e69c-4aa7-86ab-7cd78834f4a2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:06.999861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1623ccb1-57c4-47dd-9090-18f901072076 admin admin] Security group rule updated ['48d3ba92-d222-4aac-8718-805dc9a8db97'] Oct 23 00:56:07.183606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:07Z,description='Default security group',id=8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63,is_default=True,name='default',project_id='8cacb26cadaa4e89aa1212323c99f60c',revision_number=1,rules=[SecurityGroupRule(3b534b49-44f9-422f-9e40-bb0d2d3ee3a1),SecurityGroupRule(525d03d9-f992-49b0-a8c4-7eb187ea9326),SecurityGroupRule(dc8f7efc-e1d9-4aa2-8096-5881ef2236e5),SecurityGroupRule(dff0b592-b2fa-44f4-8da9-55cf6f07ea05)],shared=False,stateful=True,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.184548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.185851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='egress',ethertype='IPv6',id=3b534b49-44f9-422f-9e40-bb0d2d3ee3a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cacb26cadaa4e89aa1212323c99f60c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.186419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3b534b49-44f9-422f-9e40-bb0d2d3ee3a1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.187101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.188586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='ingress',ethertype='IPv6',id=525d03d9-f992-49b0-a8c4-7eb187ea9326,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cacb26cadaa4e89aa1212323c99f60c',protocol=,remote_address_group_id=,remote_group_id=8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63,remote_ip_prefix=,revision_number=0,security_group_id=8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.189175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (525d03d9-f992-49b0-a8c4-7eb187ea9326), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.189751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.190587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='ingress',ethertype='IPv4',id=dc8f7efc-e1d9-4aa2-8096-5881ef2236e5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cacb26cadaa4e89aa1212323c99f60c',protocol=,remote_address_group_id=,remote_group_id=8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63,remote_ip_prefix=,revision_number=0,security_group_id=8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.191125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (dc8f7efc-e1d9-4aa2-8096-5881ef2236e5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.191970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.192848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='egress',ethertype='IPv4',id=dff0b592-b2fa-44f4-8da9-55cf6f07ea05,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cacb26cadaa4e89aa1212323c99f60c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.193881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (dff0b592-b2fa-44f4-8da9-55cf6f07ea05), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.194301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e8bf6722-28c7-4426-8d3d-1d03f060eea6 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.332474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Resource SecurityGroup deleted: 8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.333934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.334949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:07.356903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:07.358123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Resource SecurityGroupRule deleted: 3b534b49-44f9-422f-9e40-bb0d2d3ee3a1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.358956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3b534b49-44f9-422f-9e40-bb0d2d3ee3a1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.360353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.360949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Resource SecurityGroupRule deleted: 525d03d9-f992-49b0-a8c4-7eb187ea9326 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.362169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (525d03d9-f992-49b0-a8c4-7eb187ea9326), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.363025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.363570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Resource SecurityGroupRule deleted: dc8f7efc-e1d9-4aa2-8096-5881ef2236e5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.364076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (dc8f7efc-e1d9-4aa2-8096-5881ef2236e5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.365122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.365667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Resource SecurityGroupRule deleted: dff0b592-b2fa-44f4-8da9-55cf6f07ea05 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.366155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (dff0b592-b2fa-44f4-8da9-55cf6f07ea05), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.366629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-91275953-ceb1-4e8b-ba24-4fe0e7e30829 admin admin] Security group rule updated ['8d1a5eb2-1b0a-477c-bc2a-8e2e94b26f63'] Oct 23 00:56:07.527920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:07Z,description='Default security group',id=f6f061b7-38cf-47c4-87d5-2856105a9768,is_default=True,name='default',project_id='58e897ded52f4fdcad19a503a7092730',revision_number=1,rules=[SecurityGroupRule(553cd0c9-563b-4acb-be08-36d193d44a54),SecurityGroupRule(68911697-abe6-41e0-9640-e691f3b3f797),SecurityGroupRule(89f1fe70-b8df-479b-a344-01a3d81362ef),SecurityGroupRule(fdd06d94-21f5-4a61-8538-2097d683061b)],shared=False,stateful=True,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.528153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (f6f061b7-38cf-47c4-87d5-2856105a9768), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.528784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='egress',ethertype='IPv6',id=553cd0c9-563b-4acb-be08-36d193d44a54,normalized_cidr=None,port_range_max=,port_range_min=,project_id='58e897ded52f4fdcad19a503a7092730',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f6f061b7-38cf-47c4-87d5-2856105a9768,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.529147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (553cd0c9-563b-4acb-be08-36d193d44a54), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.529638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.530459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='ingress',ethertype='IPv6',id=68911697-abe6-41e0-9640-e691f3b3f797,normalized_cidr=None,port_range_max=,port_range_min=,project_id='58e897ded52f4fdcad19a503a7092730',protocol=,remote_address_group_id=,remote_group_id=f6f061b7-38cf-47c4-87d5-2856105a9768,remote_ip_prefix=,revision_number=0,security_group_id=f6f061b7-38cf-47c4-87d5-2856105a9768,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.530961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (68911697-abe6-41e0-9640-e691f3b3f797), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.532993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.534365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='egress',ethertype='IPv4',id=89f1fe70-b8df-479b-a344-01a3d81362ef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='58e897ded52f4fdcad19a503a7092730',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f6f061b7-38cf-47c4-87d5-2856105a9768,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.534880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (89f1fe70-b8df-479b-a344-01a3d81362ef), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.536170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.537321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:07Z,description=,direction='ingress',ethertype='IPv4',id=fdd06d94-21f5-4a61-8538-2097d683061b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='58e897ded52f4fdcad19a503a7092730',protocol=,remote_address_group_id=,remote_group_id=f6f061b7-38cf-47c4-87d5-2856105a9768,remote_ip_prefix=,revision_number=0,security_group_id=f6f061b7-38cf-47c4-87d5-2856105a9768,updated_at=2022-10-23T00:56:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:07.538082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fdd06d94-21f5-4a61-8538-2097d683061b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.540419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e90dd172-9815-44aa-b0b1-cf2670676292 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.706182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Resource SecurityGroup deleted: f6f061b7-38cf-47c4-87d5-2856105a9768 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.706775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (f6f061b7-38cf-47c4-87d5-2856105a9768), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.707541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f6f061b7-38cf-47c4-87d5-2856105a9768',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:07.723530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f6f061b7-38cf-47c4-87d5-2856105a9768',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:07.723965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Resource SecurityGroupRule deleted: 553cd0c9-563b-4acb-be08-36d193d44a54 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.724332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (553cd0c9-563b-4acb-be08-36d193d44a54), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.724687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.725111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Resource SecurityGroupRule deleted: 68911697-abe6-41e0-9640-e691f3b3f797 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.725453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (68911697-abe6-41e0-9640-e691f3b3f797), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.725767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.726130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Resource SecurityGroupRule deleted: 89f1fe70-b8df-479b-a344-01a3d81362ef {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.726465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (89f1fe70-b8df-479b-a344-01a3d81362ef), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.726780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.727125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Resource SecurityGroupRule deleted: fdd06d94-21f5-4a61-8538-2097d683061b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:07.727575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fdd06d94-21f5-4a61-8538-2097d683061b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.727894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-474c4618-f4e1-4faf-b697-17354b44b9e7 admin admin] Security group rule updated ['f6f061b7-38cf-47c4-87d5-2856105a9768'] Oct 23 00:56:07.831479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:256 started Oct 23 00:56:07.834864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=905000000,duration_sec=528,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:07.835500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:07.835835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:256 - starting polling. Elapsed:0.005 Oct 23 00:56:07.838807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:07.843032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:256 - port information retrieved. Elapsed:0.011 Oct 23 00:56:07.843372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:256 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:56:09.624272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1315403-13b6-4bd4-874a-c628fae83c0c service neutron] Resource Port 070636ae-227f-400c-a9d9-cd7af698e161 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=070636ae-227f-400c-a9d9-cd7af698e161,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=070636ae-227f-400c-a9d9-cd7af698e161,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:09.625737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a1315403-13b6-4bd4-874a-c628fae83c0c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (070636ae-227f-400c-a9d9-cd7af698e161), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:09.832681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:257 started Oct 23 00:56:09.836092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=907000000,duration_sec=530,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:09.836994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:09.837626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:257 - starting polling. Elapsed:0.005 Oct 23 00:56:09.840402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:09.844706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:257 - port information retrieved. Elapsed:0.012 Oct 23 00:56:09.847257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:257 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 00:56:10.335502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1315403-13b6-4bd4-874a-c628fae83c0c service neutron] Resource Port 070636ae-227f-400c-a9d9-cd7af698e161 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=070636ae-227f-400c-a9d9-cd7af698e161,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=070636ae-227f-400c-a9d9-cd7af698e161,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=070636ae-227f-400c-a9d9-cd7af698e161,segment=NetworkSegment(63b58a73-ffd1-4018-ac3c-0db314c2c768),segment_id=63b58a73-ffd1-4018-ac3c-0db314c2c768)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:10.336563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a1315403-13b6-4bd4-874a-c628fae83c0c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (070636ae-227f-400c-a9d9-cd7af698e161), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:10.976081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-db4628c0-3ec6-4f75-8cc2-83acdc429e14 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:10Z,data_plane_status=None,description='',device_id='5de36a91-410e-4412-9da8-623bb2ef0014',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c4115102-acce-4a90-ab24-eb74a5879146,mac_address=fa:16:3e:d1:75:6f,name='',network_id=f8105e98-346f-4369-be4d-2cb2d399c07a,numa_affinity_policy=,project_id='59add4b78cd346a194c4be211d1996be',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c4115102-acce-4a90-ab24-eb74a5879146),security_group_ids=set([de7217fb-3148-4635-a766-93f8b6fd3faa]),status='DOWN',updated_at=2022-10-23T00:56:10Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:10.976799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-db4628c0-3ec6-4f75-8cc2-83acdc429e14 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:10.978181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-db4628c0-3ec6-4f75-8cc2-83acdc429e14 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group member updated {'de7217fb-3148-4635-a766-93f8b6fd3faa'} Oct 23 00:56:11.834062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:258 started Oct 23 00:56:11.837094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=907000000,duration_sec=532,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:11.837710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:11.838045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:258 - starting polling. Elapsed:0.004 Oct 23 00:56:11.840354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:11.843487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:258 - port information retrieved. Elapsed:0.010 Oct 23 00:56:11.843817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:258 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 00:56:13.834839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:259 started Oct 23 00:56:13.838758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2a9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=909000000,duration_sec=534,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:13.839625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:13.840156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:259 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:56:15.309163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port fdd89988-ac0b-48a6-9a93-d8efc80c0957 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:15.312065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fdd89988-ac0b-48a6-9a93-d8efc80c0957), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:15.836182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:260 started Oct 23 00:56:15.838712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aa0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=910000000,duration_sec=536,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:15.839200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:15.839601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:260 - starting polling. Elapsed:0.004 Oct 23 00:56:15.841956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:15.845021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:260 - port information retrieved. Elapsed:0.009 Oct 23 00:56:15.845465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:260 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 00:56:17.837327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:261 started Oct 23 00:56:17.840000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aa2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=911000000,duration_sec=538,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:17.840703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:17.841286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:261 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:56:18.045948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-38c038e2-e2d6-40d4-ba17-aaee3587555f service neutron] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c4115102-acce-4a90-ab24-eb74a5879146,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c4115102-acce-4a90-ab24-eb74a5879146,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:18.046352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-38c038e2-e2d6-40d4-ba17-aaee3587555f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:18.345125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-38c038e2-e2d6-40d4-ba17-aaee3587555f service neutron] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c4115102-acce-4a90-ab24-eb74a5879146,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c4115102-acce-4a90-ab24-eb74a5879146,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c4115102-acce-4a90-ab24-eb74a5879146,segment=NetworkSegment(7dc83201-cb39-4cd2-9302-c1b785eda914),segment_id=7dc83201-cb39-4cd2-9302-c1b785eda914)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:18.345547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-38c038e2-e2d6-40d4-ba17-aaee3587555f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:19.839239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:262 started Oct 23 00:56:19.843881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aa4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=915000000,duration_sec=540,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:19.844491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:19.844860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:262 - starting polling. Elapsed:0.006 Oct 23 00:56:19.847912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:19.850934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:262 - port information retrieved. Elapsed:0.012 Oct 23 00:56:19.851270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:262 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 00:56:20.647770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port fdd89988-ac0b-48a6-9a93-d8efc80c0957 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:20.648150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (fdd89988-ac0b-48a6-9a93-d8efc80c0957), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.181239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:21Z,description='Default security group',id=ca61b423-75ba-4d78-abb2-126662b6feaa,is_default=True,name='default',project_id='2830aa775ddc4188bdfcd51aa805aed0',revision_number=1,rules=[SecurityGroupRule(2af19ad1-0782-45ea-b2a7-ec35089221df),SecurityGroupRule(769cc0e8-272b-4d00-afc5-53480139bd7c),SecurityGroupRule(b62affab-a968-457b-854f-9b046181a1dc),SecurityGroupRule(ebf39d39-8b1d-4430-bc2f-88295332477a)],shared=False,stateful=True,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.181863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (ca61b423-75ba-4d78-abb2-126662b6feaa), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.182615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='ingress',ethertype='IPv4',id=2af19ad1-0782-45ea-b2a7-ec35089221df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2830aa775ddc4188bdfcd51aa805aed0',protocol=,remote_address_group_id=,remote_group_id=ca61b423-75ba-4d78-abb2-126662b6feaa,remote_ip_prefix=,revision_number=0,security_group_id=ca61b423-75ba-4d78-abb2-126662b6feaa,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.183074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2af19ad1-0782-45ea-b2a7-ec35089221df), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.183505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.184315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='egress',ethertype='IPv6',id=769cc0e8-272b-4d00-afc5-53480139bd7c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2830aa775ddc4188bdfcd51aa805aed0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ca61b423-75ba-4d78-abb2-126662b6feaa,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.184757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (769cc0e8-272b-4d00-afc5-53480139bd7c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.185145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.185877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='ingress',ethertype='IPv6',id=b62affab-a968-457b-854f-9b046181a1dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2830aa775ddc4188bdfcd51aa805aed0',protocol=,remote_address_group_id=,remote_group_id=ca61b423-75ba-4d78-abb2-126662b6feaa,remote_ip_prefix=,revision_number=0,security_group_id=ca61b423-75ba-4d78-abb2-126662b6feaa,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.186292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b62affab-a968-457b-854f-9b046181a1dc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.186684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.187500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='egress',ethertype='IPv4',id=ebf39d39-8b1d-4430-bc2f-88295332477a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2830aa775ddc4188bdfcd51aa805aed0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ca61b423-75ba-4d78-abb2-126662b6feaa,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.188013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ebf39d39-8b1d-4430-bc2f-88295332477a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.188337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0297fbaf-6b1e-4d3c-b310-abc2eeb526bf admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.482751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Resource SecurityGroup deleted: ca61b423-75ba-4d78-abb2-126662b6feaa {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:21.483259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (ca61b423-75ba-4d78-abb2-126662b6feaa), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.483721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ca61b423-75ba-4d78-abb2-126662b6feaa',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:21.509340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ca61b423-75ba-4d78-abb2-126662b6feaa',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:21.510639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Resource SecurityGroupRule deleted: 2af19ad1-0782-45ea-b2a7-ec35089221df {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:21.511257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2af19ad1-0782-45ea-b2a7-ec35089221df), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.511537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.512002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Resource SecurityGroupRule deleted: 769cc0e8-272b-4d00-afc5-53480139bd7c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:21.512470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (769cc0e8-272b-4d00-afc5-53480139bd7c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.512928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.513304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Resource SecurityGroupRule deleted: b62affab-a968-457b-854f-9b046181a1dc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:21.513629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b62affab-a968-457b-854f-9b046181a1dc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.514147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.514770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Resource SecurityGroupRule deleted: ebf39d39-8b1d-4430-bc2f-88295332477a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:21.515272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ebf39d39-8b1d-4430-bc2f-88295332477a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.515870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9704b9e2-e28b-46e6-8f4c-c9cd2fe00eb7 admin admin] Security group rule updated ['ca61b423-75ba-4d78-abb2-126662b6feaa'] Oct 23 00:56:21.839631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:263 started Oct 23 00:56:21.843850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aa6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=913000000,duration_sec=542,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:21.844677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:21.845429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:263 - starting polling. Elapsed:0.006 Oct 23 00:56:21.850197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.859570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:263 - port information retrieved. Elapsed:0.020 Oct 23 00:56:21.860509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:263 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Oct 23 00:56:21.993129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:21Z,description='Default security group',id=64abb3b8-8c40-47f7-8ee8-6a25174c7758,is_default=True,name='default',project_id='cbc0c6f9de424d78b60d8a31b5ab13d6',revision_number=1,rules=[SecurityGroupRule(238cfd1a-9026-44d6-b0a4-2b2d2ab3d460),SecurityGroupRule(24924613-fb16-4ae9-9ed6-f63f3d498f5b),SecurityGroupRule(3bb77965-f402-469f-8014-91de29138974),SecurityGroupRule(aacb3f2e-de0a-46f5-ad32-1fe506811670)],shared=False,stateful=True,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.993531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (64abb3b8-8c40-47f7-8ee8-6a25174c7758), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.994146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='ingress',ethertype='IPv4',id=238cfd1a-9026-44d6-b0a4-2b2d2ab3d460,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cbc0c6f9de424d78b60d8a31b5ab13d6',protocol=,remote_address_group_id=,remote_group_id=64abb3b8-8c40-47f7-8ee8-6a25174c7758,remote_ip_prefix=,revision_number=0,security_group_id=64abb3b8-8c40-47f7-8ee8-6a25174c7758,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.994560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (238cfd1a-9026-44d6-b0a4-2b2d2ab3d460), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.995143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:21.995553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='ingress',ethertype='IPv6',id=24924613-fb16-4ae9-9ed6-f63f3d498f5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cbc0c6f9de424d78b60d8a31b5ab13d6',protocol=,remote_address_group_id=,remote_group_id=64abb3b8-8c40-47f7-8ee8-6a25174c7758,remote_ip_prefix=,revision_number=0,security_group_id=64abb3b8-8c40-47f7-8ee8-6a25174c7758,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.995905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (24924613-fb16-4ae9-9ed6-f63f3d498f5b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.996205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:21.996898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='egress',ethertype='IPv4',id=3bb77965-f402-469f-8014-91de29138974,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cbc0c6f9de424d78b60d8a31b5ab13d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=64abb3b8-8c40-47f7-8ee8-6a25174c7758,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.997243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3bb77965-f402-469f-8014-91de29138974), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.997558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:21.998191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:21Z,description=,direction='egress',ethertype='IPv6',id=aacb3f2e-de0a-46f5-ad32-1fe506811670,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cbc0c6f9de424d78b60d8a31b5ab13d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=64abb3b8-8c40-47f7-8ee8-6a25174c7758,updated_at=2022-10-23T00:56:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:21.998531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (aacb3f2e-de0a-46f5-ad32-1fe506811670), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:21.998847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc432bf6-6238-46e1-87a3-309b18db9a8b admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:22.133560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Resource SecurityGroup deleted: 64abb3b8-8c40-47f7-8ee8-6a25174c7758 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:22.134144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (64abb3b8-8c40-47f7-8ee8-6a25174c7758), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:22.134709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('64abb3b8-8c40-47f7-8ee8-6a25174c7758',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:22.148831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('64abb3b8-8c40-47f7-8ee8-6a25174c7758',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:22.149361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Resource SecurityGroupRule deleted: 238cfd1a-9026-44d6-b0a4-2b2d2ab3d460 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:22.149790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (238cfd1a-9026-44d6-b0a4-2b2d2ab3d460), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:22.150213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:22.150663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Resource SecurityGroupRule deleted: 24924613-fb16-4ae9-9ed6-f63f3d498f5b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:22.151068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (24924613-fb16-4ae9-9ed6-f63f3d498f5b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:22.151458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:22.151834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Resource SecurityGroupRule deleted: 3bb77965-f402-469f-8014-91de29138974 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:22.152175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3bb77965-f402-469f-8014-91de29138974), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:22.152489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:22.152879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Resource SecurityGroupRule deleted: aacb3f2e-de0a-46f5-ad32-1fe506811670 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:22.153204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (aacb3f2e-de0a-46f5-ad32-1fe506811670), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:22.153515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9fca167e-681d-471d-b860-123dfca07666 admin admin] Security group rule updated ['64abb3b8-8c40-47f7-8ee8-6a25174c7758'] Oct 23 00:56:23.035580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 16ac40d6-7a56-4def-a9f5-e0a3fade7563 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:23.036384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (16ac40d6-7a56-4def-a9f5-e0a3fade7563), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:23.840878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:264 started Oct 23 00:56:23.843565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aa8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=914000000,duration_sec=544,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:23.844204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:23.844546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:264 - starting polling. Elapsed:0.004 Oct 23 00:56:23.847329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:23.851100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:264 - port information retrieved. Elapsed:0.010 Oct 23 00:56:23.851437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:264 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 00:56:24.831317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 16ac40d6-7a56-4def-a9f5-e0a3fade7563 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:24.831964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (16ac40d6-7a56-4def-a9f5-e0a3fade7563), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:25.424891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:25Z,description='Default security group',id=edb2421b-6bbc-4a3c-a6c7-9a875277fc8b,is_default=True,name='default',project_id='adccdbc6560742f49ea9d53bba467e05',revision_number=1,rules=[SecurityGroupRule(6b76b5e6-bf44-4cb2-adf8-ff4988dd0a30),SecurityGroupRule(72ca1258-b02c-40b0-a1ba-66ea1a0d6f05),SecurityGroupRule(7da7e2f5-2476-4dd9-95c1-c4739ec13158),SecurityGroupRule(98cda148-c97f-41d8-bafc-9ec987a63838)],shared=False,stateful=True,updated_at=2022-10-23T00:56:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:25.425376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (edb2421b-6bbc-4a3c-a6c7-9a875277fc8b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:25.426000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:25Z,description=,direction='ingress',ethertype='IPv6',id=6b76b5e6-bf44-4cb2-adf8-ff4988dd0a30,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adccdbc6560742f49ea9d53bba467e05',protocol=,remote_address_group_id=,remote_group_id=edb2421b-6bbc-4a3c-a6c7-9a875277fc8b,remote_ip_prefix=,revision_number=0,security_group_id=edb2421b-6bbc-4a3c-a6c7-9a875277fc8b,updated_at=2022-10-23T00:56:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:25.426359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6b76b5e6-bf44-4cb2-adf8-ff4988dd0a30), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:25.426736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Security group rule updated ['edb2421b-6bbc-4a3c-a6c7-9a875277fc8b'] Oct 23 00:56:25.427436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:25Z,description=,direction='ingress',ethertype='IPv4',id=72ca1258-b02c-40b0-a1ba-66ea1a0d6f05,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adccdbc6560742f49ea9d53bba467e05',protocol=,remote_address_group_id=,remote_group_id=edb2421b-6bbc-4a3c-a6c7-9a875277fc8b,remote_ip_prefix=,revision_number=0,security_group_id=edb2421b-6bbc-4a3c-a6c7-9a875277fc8b,updated_at=2022-10-23T00:56:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:25.427809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (72ca1258-b02c-40b0-a1ba-66ea1a0d6f05), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:25.428131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Security group rule updated ['edb2421b-6bbc-4a3c-a6c7-9a875277fc8b'] Oct 23 00:56:25.428792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:25Z,description=,direction='egress',ethertype='IPv4',id=7da7e2f5-2476-4dd9-95c1-c4739ec13158,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adccdbc6560742f49ea9d53bba467e05',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=edb2421b-6bbc-4a3c-a6c7-9a875277fc8b,updated_at=2022-10-23T00:56:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:25.429185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7da7e2f5-2476-4dd9-95c1-c4739ec13158), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:25.429444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Security group rule updated ['edb2421b-6bbc-4a3c-a6c7-9a875277fc8b'] Oct 23 00:56:25.430086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:25Z,description=,direction='egress',ethertype='IPv6',id=98cda148-c97f-41d8-bafc-9ec987a63838,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adccdbc6560742f49ea9d53bba467e05',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=edb2421b-6bbc-4a3c-a6c7-9a875277fc8b,updated_at=2022-10-23T00:56:25Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:25.430432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (98cda148-c97f-41d8-bafc-9ec987a63838), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:25.430971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-79869727-845a-40a4-a3ad-090932ab989c service neutron] Security group rule updated ['edb2421b-6bbc-4a3c-a6c7-9a875277fc8b'] Oct 23 00:56:25.842002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:265 started Oct 23 00:56:25.847007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aaa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=916000000,duration_sec=546,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:25.848144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:25.848749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:265 - starting polling. Elapsed:0.007 Oct 23 00:56:25.851271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:25.854460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:265 - port information retrieved. Elapsed:0.013 Oct 23 00:56:25.854912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:265 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 00:56:26.926543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 070636ae-227f-400c-a9d9-cd7af698e161 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:26.927202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (070636ae-227f-400c-a9d9-cd7af698e161), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:27.162014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port eaf96dfe-f805-4be4-9d2f-7507301823d2 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:27.162397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (eaf96dfe-f805-4be4-9d2f-7507301823d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:27.843115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:266 started Oct 23 00:56:27.845959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=916000000,duration_sec=548,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:27.846605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:27.846988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:266 - starting polling. Elapsed:0.004 Oct 23 00:56:27.849881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:27.852908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:266 - port information retrieved. Elapsed:0.010 Oct 23 00:56:27.853230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:266 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 00:56:29.844417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:267 started Oct 23 00:56:29.847187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=918000000,duration_sec=550,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:29.847767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:29.848124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:267 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:56:31.845558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:268 started Oct 23 00:56:31.848695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ab0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=919000000,duration_sec=552,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:31.849361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:31.849715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:268 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:56:32.043439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 070636ae-227f-400c-a9d9-cd7af698e161 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:32.044428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (070636ae-227f-400c-a9d9-cd7af698e161), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:32.350888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port eaf96dfe-f805-4be4-9d2f-7507301823d2 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:32.351271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (eaf96dfe-f805-4be4-9d2f-7507301823d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:32.906098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:32Z,description='Default security group',id=fff237dc-1509-49a1-90d3-8855996d3321,is_default=True,name='default',project_id='ab64b20fe2c543f5be98100281141038',revision_number=1,rules=[SecurityGroupRule(071f6f31-c33a-41fd-b2bd-1e80d7db95e1),SecurityGroupRule(2f0b4e92-8d90-4757-a6bc-809686cebe60),SecurityGroupRule(8666a1c3-c4ce-438e-b168-93502cc4b8a1),SecurityGroupRule(a819dd72-9545-4875-9949-9be91757bbb2)],shared=False,stateful=True,updated_at=2022-10-23T00:56:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:32.906736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (fff237dc-1509-49a1-90d3-8855996d3321), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:32.907201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:32Z,description=,direction='egress',ethertype='IPv4',id=071f6f31-c33a-41fd-b2bd-1e80d7db95e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab64b20fe2c543f5be98100281141038',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fff237dc-1509-49a1-90d3-8855996d3321,updated_at=2022-10-23T00:56:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:32.907704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (071f6f31-c33a-41fd-b2bd-1e80d7db95e1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:32.908042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:32.908901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:32Z,description=,direction='egress',ethertype='IPv6',id=2f0b4e92-8d90-4757-a6bc-809686cebe60,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab64b20fe2c543f5be98100281141038',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fff237dc-1509-49a1-90d3-8855996d3321,updated_at=2022-10-23T00:56:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:32.909261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2f0b4e92-8d90-4757-a6bc-809686cebe60), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:32.909585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:32.910237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:32Z,description=,direction='ingress',ethertype='IPv6',id=8666a1c3-c4ce-438e-b168-93502cc4b8a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab64b20fe2c543f5be98100281141038',protocol=,remote_address_group_id=,remote_group_id=fff237dc-1509-49a1-90d3-8855996d3321,remote_ip_prefix=,revision_number=0,security_group_id=fff237dc-1509-49a1-90d3-8855996d3321,updated_at=2022-10-23T00:56:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:32.911128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8666a1c3-c4ce-438e-b168-93502cc4b8a1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:32.911495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:32.912155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:32Z,description=,direction='ingress',ethertype='IPv4',id=a819dd72-9545-4875-9949-9be91757bbb2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab64b20fe2c543f5be98100281141038',protocol=,remote_address_group_id=,remote_group_id=fff237dc-1509-49a1-90d3-8855996d3321,remote_ip_prefix=,revision_number=0,security_group_id=fff237dc-1509-49a1-90d3-8855996d3321,updated_at=2022-10-23T00:56:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:32.912500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a819dd72-9545-4875-9949-9be91757bbb2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:32.913026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd5a2fcf-77e2-46dc-b5d3-bd5dce4f33fe admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:33.040220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Resource SecurityGroup deleted: fff237dc-1509-49a1-90d3-8855996d3321 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.040595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (fff237dc-1509-49a1-90d3-8855996d3321), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.041117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fff237dc-1509-49a1-90d3-8855996d3321',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:33.055958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fff237dc-1509-49a1-90d3-8855996d3321',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:33.056427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Resource SecurityGroupRule deleted: 071f6f31-c33a-41fd-b2bd-1e80d7db95e1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.056838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (071f6f31-c33a-41fd-b2bd-1e80d7db95e1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.057543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:33.058124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Resource SecurityGroupRule deleted: 2f0b4e92-8d90-4757-a6bc-809686cebe60 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.058435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2f0b4e92-8d90-4757-a6bc-809686cebe60), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.058780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:33.059467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Resource SecurityGroupRule deleted: 8666a1c3-c4ce-438e-b168-93502cc4b8a1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.060024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8666a1c3-c4ce-438e-b168-93502cc4b8a1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.060494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:33.061020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Resource SecurityGroupRule deleted: a819dd72-9545-4875-9949-9be91757bbb2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.061501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a819dd72-9545-4875-9949-9be91757bbb2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.061957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-121fa8b1-7b21-4361-b645-e2ff540cda46 admin admin] Security group rule updated ['fff237dc-1509-49a1-90d3-8855996d3321'] Oct 23 00:56:33.592267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:33Z,description='Default security group',id=f2255aaf-5b1b-4972-918f-9507bf38ca4a,is_default=True,name='default',project_id='e790b16fbe77445389379e566fb6ff71',revision_number=1,rules=[SecurityGroupRule(3b1becf3-f063-48b6-9369-b212b6229132),SecurityGroupRule(5b7c7e19-9557-40b1-864e-482fae6af36a),SecurityGroupRule(5f73a7d3-5ce6-483f-bebc-0db178f27a9c),SecurityGroupRule(97159183-9cd6-41a4-bad1-39c4ec05ed90)],shared=False,stateful=True,updated_at=2022-10-23T00:56:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:33.592899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (f2255aaf-5b1b-4972-918f-9507bf38ca4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.593455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:33Z,description=,direction='egress',ethertype='IPv6',id=3b1becf3-f063-48b6-9369-b212b6229132,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e790b16fbe77445389379e566fb6ff71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2255aaf-5b1b-4972-918f-9507bf38ca4a,updated_at=2022-10-23T00:56:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:33.593818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3b1becf3-f063-48b6-9369-b212b6229132), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.594137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:33.594802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:33Z,description=,direction='ingress',ethertype='IPv6',id=5b7c7e19-9557-40b1-864e-482fae6af36a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e790b16fbe77445389379e566fb6ff71',protocol=,remote_address_group_id=,remote_group_id=f2255aaf-5b1b-4972-918f-9507bf38ca4a,remote_ip_prefix=,revision_number=0,security_group_id=f2255aaf-5b1b-4972-918f-9507bf38ca4a,updated_at=2022-10-23T00:56:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:33.595157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5b7c7e19-9557-40b1-864e-482fae6af36a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.595499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:33.596134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:33Z,description=,direction='egress',ethertype='IPv4',id=5f73a7d3-5ce6-483f-bebc-0db178f27a9c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e790b16fbe77445389379e566fb6ff71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2255aaf-5b1b-4972-918f-9507bf38ca4a,updated_at=2022-10-23T00:56:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:33.596491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5f73a7d3-5ce6-483f-bebc-0db178f27a9c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.596966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:33.597519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:33Z,description=,direction='ingress',ethertype='IPv4',id=97159183-9cd6-41a4-bad1-39c4ec05ed90,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e790b16fbe77445389379e566fb6ff71',protocol=,remote_address_group_id=,remote_group_id=f2255aaf-5b1b-4972-918f-9507bf38ca4a,remote_ip_prefix=,revision_number=0,security_group_id=f2255aaf-5b1b-4972-918f-9507bf38ca4a,updated_at=2022-10-23T00:56:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:33.597868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (97159183-9cd6-41a4-bad1-39c4ec05ed90), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.598320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bc26ffee-e538-432a-80e2-c9bd9a500478 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:33.739833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Resource SecurityGroup deleted: f2255aaf-5b1b-4972-918f-9507bf38ca4a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.740307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (f2255aaf-5b1b-4972-918f-9507bf38ca4a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.740858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f2255aaf-5b1b-4972-918f-9507bf38ca4a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:33.846528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:269 started Oct 23 00:56:33.850306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ab2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=920000000,duration_sec=554,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:33.851380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:33.851887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:269 - starting polling. Elapsed:0.005 Oct 23 00:56:33.854991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.858961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:269 - port information retrieved. Elapsed:0.013 Oct 23 00:56:33.859303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:269 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 00:56:33.920209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f2255aaf-5b1b-4972-918f-9507bf38ca4a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:33.922316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Resource SecurityGroupRule deleted: 3b1becf3-f063-48b6-9369-b212b6229132 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.922968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3b1becf3-f063-48b6-9369-b212b6229132), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.923355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:33.923853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Resource SecurityGroupRule deleted: 5b7c7e19-9557-40b1-864e-482fae6af36a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.924391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5b7c7e19-9557-40b1-864e-482fae6af36a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.924943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:33.925304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Resource SecurityGroupRule deleted: 5f73a7d3-5ce6-483f-bebc-0db178f27a9c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.925761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5f73a7d3-5ce6-483f-bebc-0db178f27a9c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.926290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:33.926661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Resource SecurityGroupRule deleted: 97159183-9cd6-41a4-bad1-39c4ec05ed90 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:33.927152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (97159183-9cd6-41a4-bad1-39c4ec05ed90), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:33.928694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33afc594-580e-4725-8c18-b1a241e8cdf1 admin admin] Security group rule updated ['f2255aaf-5b1b-4972-918f-9507bf38ca4a'] Oct 23 00:56:35.847523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:270 started Oct 23 00:56:35.850952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ab4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=921000000,duration_sec=556,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:35.851691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:35.852066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:270 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:56:37.849149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:271 started Oct 23 00:56:37.853336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ab6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=923000000,duration_sec=558,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:37.854199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:37.854697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:271 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:56:39.849768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:272 started Oct 23 00:56:39.853554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ab8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=924000000,duration_sec=560,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:39.854475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:39.855032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:272 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:56:39.880791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:39.881517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:41.851338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:273 started Oct 23 00:56:41.854835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=925000000,duration_sec=562,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:41.855435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:41.855818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:273 - starting polling. Elapsed:0.005 Oct 23 00:56:41.859062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:41.864094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:273 - port information retrieved. Elapsed:0.013 Oct 23 00:56:41.866101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:273 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 23 00:56:42.044306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:42.044632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.252884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:42Z,description='Default security group',id=71b84096-6653-4439-b3c3-7bcbc24db6a8,is_default=True,name='default',project_id='440259bc3cfd4228adca7ad18d488c17',revision_number=1,rules=[SecurityGroupRule(178b6753-0a73-4bc9-af87-dc5db1cb8fe0),SecurityGroupRule(507873fc-8198-4e6f-9410-11112a747fcb),SecurityGroupRule(669cb6f9-9de3-484a-80b7-de4d9c346867),SecurityGroupRule(a7f8cb4c-d166-4dc4-b942-72d837b5953b)],shared=False,stateful=True,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.254181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (71b84096-6653-4439-b3c3-7bcbc24db6a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.255262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='ingress',ethertype='IPv4',id=178b6753-0a73-4bc9-af87-dc5db1cb8fe0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='440259bc3cfd4228adca7ad18d488c17',protocol=,remote_address_group_id=,remote_group_id=71b84096-6653-4439-b3c3-7bcbc24db6a8,remote_ip_prefix=,revision_number=0,security_group_id=71b84096-6653-4439-b3c3-7bcbc24db6a8,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.255903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (178b6753-0a73-4bc9-af87-dc5db1cb8fe0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.261785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.263355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='egress',ethertype='IPv4',id=507873fc-8198-4e6f-9410-11112a747fcb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='440259bc3cfd4228adca7ad18d488c17',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=71b84096-6653-4439-b3c3-7bcbc24db6a8,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.266168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (507873fc-8198-4e6f-9410-11112a747fcb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.267527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.269997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='egress',ethertype='IPv6',id=669cb6f9-9de3-484a-80b7-de4d9c346867,normalized_cidr=None,port_range_max=,port_range_min=,project_id='440259bc3cfd4228adca7ad18d488c17',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=71b84096-6653-4439-b3c3-7bcbc24db6a8,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.271403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (669cb6f9-9de3-484a-80b7-de4d9c346867), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.275819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.277462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='ingress',ethertype='IPv6',id=a7f8cb4c-d166-4dc4-b942-72d837b5953b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='440259bc3cfd4228adca7ad18d488c17',protocol=,remote_address_group_id=,remote_group_id=71b84096-6653-4439-b3c3-7bcbc24db6a8,remote_ip_prefix=,revision_number=0,security_group_id=71b84096-6653-4439-b3c3-7bcbc24db6a8,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.278885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a7f8cb4c-d166-4dc4-b942-72d837b5953b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.280177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f93429f5-77a9-48ef-b8c1-fe1a6cb008c0 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.360118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:42Z,description='Default security group',id=31102f10-a47d-4f13-bfff-637a3a4f0723,is_default=True,name='default',project_id='9df942599ee74b6298a13cef68f67020',revision_number=1,rules=[SecurityGroupRule(201848f8-88f0-4841-96bd-5f036c4215cb),SecurityGroupRule(2656f4b3-7511-4312-9837-9918910f4667),SecurityGroupRule(7dfa56ae-ac28-4c29-b2db-7086c7bb4cd6),SecurityGroupRule(a3e2ad95-8bd4-44de-a997-cafcc018adbc)],shared=False,stateful=True,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.360832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (31102f10-a47d-4f13-bfff-637a3a4f0723), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.361662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='egress',ethertype='IPv4',id=201848f8-88f0-4841-96bd-5f036c4215cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9df942599ee74b6298a13cef68f67020',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=31102f10-a47d-4f13-bfff-637a3a4f0723,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.362718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (201848f8-88f0-4841-96bd-5f036c4215cb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.369085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:42.370351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='egress',ethertype='IPv6',id=2656f4b3-7511-4312-9837-9918910f4667,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9df942599ee74b6298a13cef68f67020',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=31102f10-a47d-4f13-bfff-637a3a4f0723,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.370915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2656f4b3-7511-4312-9837-9918910f4667), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.372195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:42.373501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='ingress',ethertype='IPv6',id=7dfa56ae-ac28-4c29-b2db-7086c7bb4cd6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9df942599ee74b6298a13cef68f67020',protocol=,remote_address_group_id=,remote_group_id=31102f10-a47d-4f13-bfff-637a3a4f0723,remote_ip_prefix=,revision_number=0,security_group_id=31102f10-a47d-4f13-bfff-637a3a4f0723,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.374035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7dfa56ae-ac28-4c29-b2db-7086c7bb4cd6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.374280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:42.375087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:42Z,description=,direction='ingress',ethertype='IPv4',id=a3e2ad95-8bd4-44de-a997-cafcc018adbc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9df942599ee74b6298a13cef68f67020',protocol=,remote_address_group_id=,remote_group_id=31102f10-a47d-4f13-bfff-637a3a4f0723,remote_ip_prefix=,revision_number=0,security_group_id=31102f10-a47d-4f13-bfff-637a3a4f0723,updated_at=2022-10-23T00:56:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:42.375594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a3e2ad95-8bd4-44de-a997-cafcc018adbc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.376083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e4a7a16b-48e3-4d3d-94f8-17abb99b3833 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:42.567734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Resource SecurityGroup deleted: 71b84096-6653-4439-b3c3-7bcbc24db6a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.568160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (71b84096-6653-4439-b3c3-7bcbc24db6a8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.568647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('71b84096-6653-4439-b3c3-7bcbc24db6a8',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:42.593135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('71b84096-6653-4439-b3c3-7bcbc24db6a8',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:42.593844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Resource SecurityGroupRule deleted: 178b6753-0a73-4bc9-af87-dc5db1cb8fe0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.597188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (178b6753-0a73-4bc9-af87-dc5db1cb8fe0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.598064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.599332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Resource SecurityGroupRule deleted: 507873fc-8198-4e6f-9410-11112a747fcb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.599969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (507873fc-8198-4e6f-9410-11112a747fcb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.602450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.602450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Resource SecurityGroupRule deleted: 669cb6f9-9de3-484a-80b7-de4d9c346867 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.604231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (669cb6f9-9de3-484a-80b7-de4d9c346867), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.604752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.606609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Resource SecurityGroupRule deleted: a7f8cb4c-d166-4dc4-b942-72d837b5953b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.607035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a7f8cb4c-d166-4dc4-b942-72d837b5953b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.607432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e62239ec-fdd3-45b8-aa6f-4106f9501de4 admin admin] Security group rule updated ['71b84096-6653-4439-b3c3-7bcbc24db6a8'] Oct 23 00:56:42.615158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Resource SecurityGroup deleted: 31102f10-a47d-4f13-bfff-637a3a4f0723 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.619742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (31102f10-a47d-4f13-bfff-637a3a4f0723), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.620340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('31102f10-a47d-4f13-bfff-637a3a4f0723',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:42.647063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('31102f10-a47d-4f13-bfff-637a3a4f0723',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:42.647891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Resource SecurityGroupRule deleted: 201848f8-88f0-4841-96bd-5f036c4215cb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.649248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (201848f8-88f0-4841-96bd-5f036c4215cb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.650627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:42.653290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Resource SecurityGroupRule deleted: 2656f4b3-7511-4312-9837-9918910f4667 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.653867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2656f4b3-7511-4312-9837-9918910f4667), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.654403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:42.654976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Resource SecurityGroupRule deleted: 7dfa56ae-ac28-4c29-b2db-7086c7bb4cd6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.655954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7dfa56ae-ac28-4c29-b2db-7086c7bb4cd6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.658681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:42.659226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Resource SecurityGroupRule deleted: a3e2ad95-8bd4-44de-a997-cafcc018adbc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:42.659628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a3e2ad95-8bd4-44de-a997-cafcc018adbc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:42.659951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f0b5ed92-b087-4e39-81f6-42ef46680db8 admin admin] Security group rule updated ['31102f10-a47d-4f13-bfff-637a3a4f0723'] Oct 23 00:56:43.328813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:43Z,description='Default security group',id=313efd4e-c637-4245-883c-12888708cba8,is_default=True,name='default',project_id='f222577e2cdf4b32815c06eb18cd3fb4',revision_number=1,rules=[SecurityGroupRule(1ba7771a-5660-4fe9-91ec-61bd04a4dace),SecurityGroupRule(90aa785f-88c6-42f8-9589-66d154ff2aa2),SecurityGroupRule(a6cd0982-1ec4-4470-ba30-4132d32ed85d),SecurityGroupRule(be8b803c-d160-49df-b958-65b8d57de786)],shared=False,stateful=True,updated_at=2022-10-23T00:56:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:43.329379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (313efd4e-c637-4245-883c-12888708cba8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.329787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:43Z,description=,direction='egress',ethertype='IPv4',id=1ba7771a-5660-4fe9-91ec-61bd04a4dace,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f222577e2cdf4b32815c06eb18cd3fb4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=313efd4e-c637-4245-883c-12888708cba8,updated_at=2022-10-23T00:56:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:43.330220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1ba7771a-5660-4fe9-91ec-61bd04a4dace), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.330583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.331288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:43Z,description=,direction='ingress',ethertype='IPv4',id=90aa785f-88c6-42f8-9589-66d154ff2aa2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f222577e2cdf4b32815c06eb18cd3fb4',protocol=,remote_address_group_id=,remote_group_id=313efd4e-c637-4245-883c-12888708cba8,remote_ip_prefix=,revision_number=0,security_group_id=313efd4e-c637-4245-883c-12888708cba8,updated_at=2022-10-23T00:56:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:43.331640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (90aa785f-88c6-42f8-9589-66d154ff2aa2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.331960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.332654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:43Z,description=,direction='ingress',ethertype='IPv6',id=a6cd0982-1ec4-4470-ba30-4132d32ed85d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f222577e2cdf4b32815c06eb18cd3fb4',protocol=,remote_address_group_id=,remote_group_id=313efd4e-c637-4245-883c-12888708cba8,remote_ip_prefix=,revision_number=0,security_group_id=313efd4e-c637-4245-883c-12888708cba8,updated_at=2022-10-23T00:56:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:43.354286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a6cd0982-1ec4-4470-ba30-4132d32ed85d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.354675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.355439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:43Z,description=,direction='egress',ethertype='IPv6',id=be8b803c-d160-49df-b958-65b8d57de786,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f222577e2cdf4b32815c06eb18cd3fb4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=313efd4e-c637-4245-883c-12888708cba8,updated_at=2022-10-23T00:56:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:43.355792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (be8b803c-d160-49df-b958-65b8d57de786), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.366459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2eedad9a-f162-4338-9a6e-e4d2f356c17d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.634996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Resource SecurityGroup deleted: 313efd4e-c637-4245-883c-12888708cba8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:43.636042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (313efd4e-c637-4245-883c-12888708cba8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.636508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('313efd4e-c637-4245-883c-12888708cba8',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:43.650190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('313efd4e-c637-4245-883c-12888708cba8',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:43.651250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Resource SecurityGroupRule deleted: 1ba7771a-5660-4fe9-91ec-61bd04a4dace {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:43.652203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1ba7771a-5660-4fe9-91ec-61bd04a4dace), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.652805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.653861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Resource SecurityGroupRule deleted: 90aa785f-88c6-42f8-9589-66d154ff2aa2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:43.654568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (90aa785f-88c6-42f8-9589-66d154ff2aa2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.655378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.655967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Resource SecurityGroupRule deleted: a6cd0982-1ec4-4470-ba30-4132d32ed85d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:43.659248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a6cd0982-1ec4-4470-ba30-4132d32ed85d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.659774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.660304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Resource SecurityGroupRule deleted: be8b803c-d160-49df-b958-65b8d57de786 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:43.661988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (be8b803c-d160-49df-b958-65b8d57de786), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.664806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fff7461f-614c-453f-85d5-200836f6655d admin admin] Security group rule updated ['313efd4e-c637-4245-883c-12888708cba8'] Oct 23 00:56:43.855319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:274 started Oct 23 00:56:43.858980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2abc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=929000000,duration_sec=564,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:43.859739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:43.860190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:274 - starting polling. Elapsed:0.006 Oct 23 00:56:43.864396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:43.868087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:274 - port information retrieved. Elapsed:0.014 Oct 23 00:56:43.868542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:274 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 23 00:56:44.174505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:44Z,description='Default security group',id=c2046e9a-95a0-4c55-917f-3d9a7035dab5,is_default=True,name='default',project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',revision_number=1,rules=[SecurityGroupRule(07520b25-2967-4f6e-9262-033f016855f5),SecurityGroupRule(5041ad21-1fe7-4682-b4a0-5ec1e06c1cc4),SecurityGroupRule(6426534e-9e2c-4cd8-bf2a-1586851ce11c),SecurityGroupRule(ddbb787d-d0f9-4228-8dfe-9499e25dbbc2)],shared=False,stateful=True,updated_at=2022-10-23T00:56:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:44.175088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (c2046e9a-95a0-4c55-917f-3d9a7035dab5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:44.177121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:44Z,description=,direction='ingress',ethertype='IPv6',id=07520b25-2967-4f6e-9262-033f016855f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol=,remote_address_group_id=,remote_group_id=c2046e9a-95a0-4c55-917f-3d9a7035dab5,remote_ip_prefix=,revision_number=0,security_group_id=c2046e9a-95a0-4c55-917f-3d9a7035dab5,updated_at=2022-10-23T00:56:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:44.192243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (07520b25-2967-4f6e-9262-033f016855f5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:44.196224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 00:56:44.206140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:44Z,description=,direction='egress',ethertype='IPv6',id=5041ad21-1fe7-4682-b4a0-5ec1e06c1cc4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c2046e9a-95a0-4c55-917f-3d9a7035dab5,updated_at=2022-10-23T00:56:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:44.206772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5041ad21-1fe7-4682-b4a0-5ec1e06c1cc4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:44.216233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 00:56:44.217520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:44Z,description=,direction='ingress',ethertype='IPv4',id=6426534e-9e2c-4cd8-bf2a-1586851ce11c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol=,remote_address_group_id=,remote_group_id=c2046e9a-95a0-4c55-917f-3d9a7035dab5,remote_ip_prefix=,revision_number=0,security_group_id=c2046e9a-95a0-4c55-917f-3d9a7035dab5,updated_at=2022-10-23T00:56:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:44.218241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6426534e-9e2c-4cd8-bf2a-1586851ce11c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:44.218738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 00:56:44.219763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:44Z,description=,direction='egress',ethertype='IPv4',id=ddbb787d-d0f9-4228-8dfe-9499e25dbbc2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c2046e9a-95a0-4c55-917f-3d9a7035dab5,updated_at=2022-10-23T00:56:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:44.220256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ddbb787d-d0f9-4228-8dfe-9499e25dbbc2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:44.220756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 00:56:44.419170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:56:44Z,description='',dns_domain=None,id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,mtu=1500,name='tempest-TestVolumeBootPattern-98750219-network',project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(858cf055-6f06-45a9-bd3f-2b834e6b7b79),segments=[NetworkSegment(d3b56b04-e2e1-4f00-a9db-1de40f8c425f)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:56:44Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:44.419855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (858cf055-6f06-45a9-bd3f-2b834e6b7b79), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-08fc0228-db40-480e-a311-56609f3deff6 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 858cf055-6f06-45a9-bd3f-2b834e6b7b79 with segmentation id not found. Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:56:44.537213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:56:44.538444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:56:44.538444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:56:44.538444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:56:44.538444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 858cf055-6f06-45a9-bd3f-2b834e6b7b79 with segmentation id not found. Oct 23 00:56:44.538444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:56:44.913254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ac23114c-499b-4c15-b6e2-bf687b73ba3b admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(cca09195-0ad8-48d8-9904-80d9517a3e3e)],cidr=172.20.0.0/28,created_at=2022-10-23T00:56:44Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=6978021c-740e-4d5a-a551-8462e322d9a8,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-98750219-subnet',network_id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:56:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:44.913254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ac23114c-499b-4c15-b6e2-bf687b73ba3b admin admin] Publish callbacks [] for Subnet (6978021c-740e-4d5a-a551-8462e322d9a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:45.668011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4f8526fd-0271-44a9-a2d9-f81155797e46 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:45Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-858cf055-6f06-45a9-bd3f-2b834e6b7b79',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f,mac_address=fa:16:3e:07:ff:aa,name='',network_id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,numa_affinity_policy=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:56:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:45.669159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4f8526fd-0271-44a9-a2d9-f81155797e46 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:45.854699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:275 started Oct 23 00:56:45.859554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2abe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=929000000,duration_sec=566,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:45.860832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:45.862804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:275 - starting polling. Elapsed:0.007 Oct 23 00:56:45.865737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:45.870309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:275 - port information retrieved. Elapsed:0.016 Oct 23 00:56:45.871267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:275 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 00:56:45.968369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4f8526fd-0271-44a9-a2d9-f81155797e46 None None] Resource Port 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f,segment=NetworkSegment(d3b56b04-e2e1-4f00-a9db-1de40f8c425f),segment_id=d3b56b04-e2e1-4f00-a9db-1de40f8c425f)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:45.969054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4f8526fd-0271-44a9-a2d9-f81155797e46 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:46.181587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0996e78c-947e-4bc9-b711-66442f5601b8","insert","tap8e19ef52-eb",["set",[]],["map",[["attached-mac","fa:16:3e:07:ff:aa"],["iface-id","8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:46.194054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0996e78c-947e-4bc9-b711-66442f5601b8","old",null,["set",[]],null],["","new","tap8e19ef52-eb",18,["map",[["attached-mac","fa:16:3e:07:ff:aa"],["iface-id","8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:46.844170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b16ad380-cbdb-4e38-b4df-545aaf8f7fc5 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:46Z,data_plane_status=None,description='',device_id='63e9c62b-0504-4d3f-bdb7-d47b057b9cb0',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2b62c892-4abb-42c7-af27-c6803021dfdd,mac_address=fa:16:3e:24:81:4b,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2b62c892-4abb-42c7-af27-c6803021dfdd),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:56:46Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:46.844865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b16ad380-cbdb-4e38-b4df-545aaf8f7fc5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2b62c892-4abb-42c7-af27-c6803021dfdd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:47.395344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-484bb3e4-2e45-44af-b289-3c82d245d68f None None] Resource Port 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:47.395837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-484bb3e4-2e45-44af-b289-3c82d245d68f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:47.856834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:276 started Oct 23 00:56:47.861466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ac0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=931000000,duration_sec=568,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:47.862337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:47.863000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:276 - starting polling. Elapsed:0.007 Oct 23 00:56:47.865829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:47.876484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:276 - port information retrieved. Elapsed:0.016 Oct 23 00:56:47.876484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39'}, 'added': {'8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f'}, 'removed': set(), 'updated': {'8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:56:47.876678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'network_id': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'port_id': '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'mac_address': 'fa:16:3e:07:ff:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 383, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6978021c-740e-4d5a-a551-8462e322d9a8', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:47.880136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:47.880585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f updated. Details: {'device': '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'network_id': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'port_id': '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'mac_address': 'fa:16:3e:07:ff:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 383, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6978021c-740e-4d5a-a551-8462e322d9a8', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:56:47.881175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 8 as local vlan for net-id=858cf055-6f06-45a9-bd3f-2b834e6b7b79, seg-id=383 Oct 23 00:56:47.886693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211935,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4479), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:47.890413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2ac2,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4104)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4479}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:47.891869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8e19ef52-eb, col_values=(('tag', 8),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:47.892593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8e19ef52-eb, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:47.893174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8e19ef52-eb, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:47.913396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8e19ef52-eb, col_values=(('other_config', {'net_uuid': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '383'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:47.931871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ac4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:47.932228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:276 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.059 Oct 23 00:56:47.932576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:56:47.932916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f'} Oct 23 00:56:47.934068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:47.934347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:47.939468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:56:47.991184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[0112fde7-694f-474c-a1e9-9107e2d3bcd1]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:56:47.992059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:276 - agent port security group processed in 0.119 Oct 23 00:56:47.993118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:48.140325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f'] and devices down [] completed. Oct 23 00:56:48.140630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:276 - ports processed. Elapsed:0.284 Oct 23 00:56:48.141006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:276 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.284 Oct 23 00:56:48.991009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a9876c11-3883-4aad-b9d1-8ec321739a7b None None] Resource Port 2b62c892-4abb-42c7-af27-c6803021dfdd updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=2b62c892-4abb-42c7-af27-c6803021dfdd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2b62c892-4abb-42c7-af27-c6803021dfdd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:48.991718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a9876c11-3883-4aad-b9d1-8ec321739a7b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2b62c892-4abb-42c7-af27-c6803021dfdd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:49.011785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9edcc470-4a0f-4bce-aa43-c9d70c404ce5 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:48Z,data_plane_status=None,description='',device_id='63e9c62b-0504-4d3f-bdb7-d47b057b9cb0',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7e98a342-e446-43cd-a9ad-e1e77aed3807,mac_address=fa:16:3e:dd:c5:dc,name='',network_id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,numa_affinity_policy=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7e98a342-e446-43cd-a9ad-e1e77aed3807),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:56:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:49.014091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9edcc470-4a0f-4bce-aa43-c9d70c404ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (7e98a342-e446-43cd-a9ad-e1e77aed3807), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:49.366423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a9876c11-3883-4aad-b9d1-8ec321739a7b None None] Resource Port 2b62c892-4abb-42c7-af27-c6803021dfdd updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2b62c892-4abb-42c7-af27-c6803021dfdd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2b62c892-4abb-42c7-af27-c6803021dfdd,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2b62c892-4abb-42c7-af27-c6803021dfdd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:49.367188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a9876c11-3883-4aad-b9d1-8ec321739a7b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2b62c892-4abb-42c7-af27-c6803021dfdd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:49.448842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9edcc470-4a0f-4bce-aa43-c9d70c404ce5 admin admin] Received resource Port update without any changes: 7e98a342-e446-43cd-a9ad-e1e77aed3807 {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:56:49.806736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ec61826d-8c97-4e94-81df-b3d654aabce3","insert","qr-7e98a342-e4",["set",[]],["map",[["attached-mac","fa:16:3e:dd:c5:dc"],["iface-id","7e98a342-e446-43cd-a9ad-e1e77aed3807"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:49.838239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ec61826d-8c97-4e94-81df-b3d654aabce3","old",null,["set",[]],null],["","new","qr-7e98a342-e4",19,["map",[["attached-mac","fa:16:3e:dd:c5:dc"],["iface-id","7e98a342-e446-43cd-a9ad-e1e77aed3807"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:49.857404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:277 started Oct 23 00:56:49.861331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ac6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=932000000,duration_sec=570,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:49.865951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:49.866468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:277 - starting polling. Elapsed:0.009 Oct 23 00:56:49.871403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:49.875145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:277 - port information retrieved. Elapsed:0.018 Oct 23 00:56:49.875474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39'}, 'added': {'7e98a342-e446-43cd-a9ad-e1e77aed3807'}, 'removed': set(), 'updated': {'7e98a342-e446-43cd-a9ad-e1e77aed3807'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:56:49.876410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:48Z,data_plane_status=None,description='',device_id='63e9c62b-0504-4d3f-bdb7-d47b057b9cb0',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7e98a342-e446-43cd-a9ad-e1e77aed3807,mac_address=fa:16:3e:dd:c5:dc,name='',network_id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,numa_affinity_policy=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(7e98a342-e446-43cd-a9ad-e1e77aed3807),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:56:49Z) is not bound. Oct 23 00:56:49.880204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 7e98a342-e446-43cd-a9ad-e1e77aed3807 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:49.880667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device 7e98a342-e446-43cd-a9ad-e1e77aed3807 not defined on plugin or binding failed Oct 23 00:56:49.881421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:277 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.006 Oct 23 00:56:49.881743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:56:49.882044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'7e98a342-e446-43cd-a9ad-e1e77aed3807'} Oct 23 00:56:49.882996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:49.883420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:49.890613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:277 - agent port security group processed in 0.015 Oct 23 00:56:49.893043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 00:56:49.893507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:277 - ports processed. Elapsed:0.036 Oct 23 00:56:49.893836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:277 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.037 Oct 23 00:56:50.254002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b1401eae-ad57-4170-9156-c4f63afe539f","insert","qg-2b62c892-4a",["set",[]],["map",[["attached-mac","fa:16:3e:24:81:4b"],["iface-id","2b62c892-4abb-42c7-af27-c6803021dfdd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:50.279431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b1401eae-ad57-4170-9156-c4f63afe539f","old",null,["set",[]],null],["","new","qg-2b62c892-4a",20,["map",[["attached-mac","fa:16:3e:24:81:4b"],["iface-id","2b62c892-4abb-42c7-af27-c6803021dfdd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:50.590675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:50Z,description='Default security group',id=fc42b5e2-044d-4a87-a887-aeaedf9f364b,is_default=True,name='default',project_id='8583a220baac4aa6874e0f5341f87171',revision_number=1,rules=[SecurityGroupRule(43a2cb01-f028-477d-930d-3573b4ac2f2e),SecurityGroupRule(794530a2-b611-4e00-80aa-f266357c983d),SecurityGroupRule(7d60977d-db40-4040-abd7-1af2e14a1bf8),SecurityGroupRule(e5680287-6a7b-47f5-a9cf-479bac3362cf)],shared=False,stateful=True,updated_at=2022-10-23T00:56:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:50.591584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (fc42b5e2-044d-4a87-a887-aeaedf9f364b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:50.592494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:50Z,description=,direction='egress',ethertype='IPv6',id=43a2cb01-f028-477d-930d-3573b4ac2f2e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8583a220baac4aa6874e0f5341f87171',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fc42b5e2-044d-4a87-a887-aeaedf9f364b,updated_at=2022-10-23T00:56:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:50.593205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (43a2cb01-f028-477d-930d-3573b4ac2f2e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:50.593719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 00:56:50.594580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:50Z,description=,direction='ingress',ethertype='IPv6',id=794530a2-b611-4e00-80aa-f266357c983d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8583a220baac4aa6874e0f5341f87171',protocol=,remote_address_group_id=,remote_group_id=fc42b5e2-044d-4a87-a887-aeaedf9f364b,remote_ip_prefix=,revision_number=0,security_group_id=fc42b5e2-044d-4a87-a887-aeaedf9f364b,updated_at=2022-10-23T00:56:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:50.595032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (794530a2-b611-4e00-80aa-f266357c983d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:50.595451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 00:56:50.596203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:50Z,description=,direction='ingress',ethertype='IPv4',id=7d60977d-db40-4040-abd7-1af2e14a1bf8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8583a220baac4aa6874e0f5341f87171',protocol=,remote_address_group_id=,remote_group_id=fc42b5e2-044d-4a87-a887-aeaedf9f364b,remote_ip_prefix=,revision_number=0,security_group_id=fc42b5e2-044d-4a87-a887-aeaedf9f364b,updated_at=2022-10-23T00:56:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:50.596889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7d60977d-db40-4040-abd7-1af2e14a1bf8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:50.598062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 00:56:50.598941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:50Z,description=,direction='egress',ethertype='IPv4',id=e5680287-6a7b-47f5-a9cf-479bac3362cf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8583a220baac4aa6874e0f5341f87171',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fc42b5e2-044d-4a87-a887-aeaedf9f364b,updated_at=2022-10-23T00:56:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:50.599388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e5680287-6a7b-47f5-a9cf-479bac3362cf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:50.599829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 00:56:50.737105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:56:50Z,description='',dns_domain=None,id=3671536d-8aa1-44fa-b916-8136fb2fa9f6,mtu=1500,name='tempest-TestVolumeBootPattern-1243917946-network',project_id='8583a220baac4aa6874e0f5341f87171',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3671536d-8aa1-44fa-b916-8136fb2fa9f6),segments=[NetworkSegment(e815dbec-503c-49d3-92df-c327e2f51879)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:56:50Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:50.738621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (3671536d-8aa1-44fa-b916-8136fb2fa9f6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-40039918-782a-4d2b-9d97-d2a9cfea4cd5 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3671536d-8aa1-44fa-b916-8136fb2fa9f6 with segmentation id not found. Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:56:50.819844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:56:50.820651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:56:50.820651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:56:50.820651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:56:50.820651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3671536d-8aa1-44fa-b916-8136fb2fa9f6 with segmentation id not found. Oct 23 00:56:50.820651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:56:51.049060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33e9fecb-d3ae-4e5c-a0a2-5f9adb1d3765 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e404de40-b2fa-4003-8566-996f05679e51)],cidr=172.20.0.0/28,created_at=2022-10-23T00:56:50Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=0fa7088a-c070-4968-8e67-305bb07f64cf,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-1243917946-subnet',network_id=3671536d-8aa1-44fa-b916-8136fb2fa9f6,project_id='8583a220baac4aa6874e0f5341f87171',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:56:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:51.049745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33e9fecb-d3ae-4e5c-a0a2-5f9adb1d3765 admin admin] Publish callbacks [] for Subnet (0fa7088a-c070-4968-8e67-305bb07f64cf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:51.869095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:278 started Oct 23 00:56:51.875833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ac8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=943000000,duration_sec=572,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:51.876629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:51.877843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:278 - starting polling. Elapsed:0.009 Oct 23 00:56:51.880902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:51.889088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:278 - port information retrieved. Elapsed:0.016 Oct 23 00:56:51.889768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:56:51.890539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'mac_address': 'fa:16:3e:24:81:4b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.242'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:51.895664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 2b62c892-4abb-42c7-af27-c6803021dfdd {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:51.900806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2b62c892-4abb-42c7-af27-c6803021dfdd updated. Details: {'device': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'mac_address': 'fa:16:3e:24:81:4b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.242'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:56:51.903841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2b62c892-4a, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:51.904448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-2b62c892-4a, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:51.904902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-2b62c892-4a, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:51.917024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-520fa15e-9e2b-4701-a3d5-9291753f1264 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:51Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3671536d-8aa1-44fa-b916-8136fb2fa9f6',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=cac42123-50aa-4652-9152-a69ff5b9a35d,mac_address=fa:16:3e:fe:e7:63,name='',network_id=3671536d-8aa1-44fa-b916-8136fb2fa9f6,numa_affinity_policy=,project_id='8583a220baac4aa6874e0f5341f87171',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(cac42123-50aa-4652-9152-a69ff5b9a35d),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:56:51Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:51.937670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-520fa15e-9e2b-4701-a3d5-9291753f1264 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cac42123-50aa-4652-9152-a69ff5b9a35d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:51.949343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2b62c892-4a, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:51.971939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2aca,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:51.972288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:278 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.082 Oct 23 00:56:51.972633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:56:51.972952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'2b62c892-4abb-42c7-af27-c6803021dfdd'} Oct 23 00:56:51.974111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:51.974390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:51.980282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:56:52.039975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f725f4-8759-446f-a7ec-5212a9170143]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:56:52.042600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:278 - agent port security group processed in 0.152 Oct 23 00:56:52.043694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 2b62c892-4abb-42c7-af27-c6803021dfdd to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:52.205700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da748fd6-96f6-4c9c-9200-7187135e2bb5 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:51Z,data_plane_status=None,description='',device_id='53f557d1-b75d-4835-9f36-d774c5942bfc',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,mac_address=fa:16:3e:67:f5:55,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0a49bf77-51b1-4891-aa10-f1dbb529cfe2),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:56:51Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:52.206067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-da748fd6-96f6-4c9c-9200-7187135e2bb5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a49bf77-51b1-4891-aa10-f1dbb529cfe2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:52.417447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a89cc106-b716-4306-a51f-617bfa1f7adb","insert","tapcac42123-50",["set",[]],["map",[["attached-mac","fa:16:3e:fe:e7:63"],["iface-id","cac42123-50aa-4652-9152-a69ff5b9a35d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:52.425478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a89cc106-b716-4306-a51f-617bfa1f7adb","old",null,["set",[]],null],["","new","tapcac42123-50",21,["map",[["attached-mac","fa:16:3e:fe:e7:63"],["iface-id","cac42123-50aa-4652-9152-a69ff5b9a35d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:52.442298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-520fa15e-9e2b-4701-a3d5-9291753f1264 None None] Resource Port cac42123-50aa-4652-9152-a69ff5b9a35d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=cac42123-50aa-4652-9152-a69ff5b9a35d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=cac42123-50aa-4652-9152-a69ff5b9a35d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=cac42123-50aa-4652-9152-a69ff5b9a35d,segment=NetworkSegment(e815dbec-503c-49d3-92df-c327e2f51879),segment_id=e815dbec-503c-49d3-92df-c327e2f51879)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:52.446339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-520fa15e-9e2b-4701-a3d5-9291753f1264 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cac42123-50aa-4652-9152-a69ff5b9a35d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:52.585167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['2b62c892-4abb-42c7-af27-c6803021dfdd'] and devices down [] completed. Oct 23 00:56:52.585766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:278 - ports processed. Elapsed:0.717 Oct 23 00:56:52.586234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:278 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.717 Oct 23 00:56:52.673139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 2b62c892-4abb-42c7-af27-c6803021dfdd updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2b62c892-4abb-42c7-af27-c6803021dfdd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2b62c892-4abb-42c7-af27-c6803021dfdd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:52.673721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2b62c892-4abb-42c7-af27-c6803021dfdd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:53.119917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-299a2fe4-9d0e-4df9-932a-5a144b8fb483 None None] Resource Port 7e98a342-e446-43cd-a9ad-e1e77aed3807 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=7e98a342-e446-43cd-a9ad-e1e77aed3807,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7e98a342-e446-43cd-a9ad-e1e77aed3807,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:53.120606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-299a2fe4-9d0e-4df9-932a-5a144b8fb483 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (7e98a342-e446-43cd-a9ad-e1e77aed3807), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:53.481303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-299a2fe4-9d0e-4df9-932a-5a144b8fb483 None None] Resource Port 7e98a342-e446-43cd-a9ad-e1e77aed3807 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7e98a342-e446-43cd-a9ad-e1e77aed3807,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7e98a342-e446-43cd-a9ad-e1e77aed3807,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7e98a342-e446-43cd-a9ad-e1e77aed3807,segment=NetworkSegment(d3b56b04-e2e1-4f00-a9db-1de40f8c425f),segment_id=d3b56b04-e2e1-4f00-a9db-1de40f8c425f)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:53.482044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-299a2fe4-9d0e-4df9-932a-5a144b8fb483 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (7e98a342-e446-43cd-a9ad-e1e77aed3807), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:53.745921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-795eb30c-7f70-493b-a646-031228648727 None None] Resource Port 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:53.746730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-795eb30c-7f70-493b-a646-031228648727 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a49bf77-51b1-4891-aa10-f1dbb529cfe2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:53.869724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:279 started Oct 23 00:56:53.874565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2acc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=944000000,duration_sec=574,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:53.876300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:53.876991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:279 - starting polling. Elapsed:0.007 Oct 23 00:56:53.880158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:53.887310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:279 - port information retrieved. Elapsed:0.018 Oct 23 00:56:53.888129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'cac42123-50aa-4652-9152-a69ff5b9a35d'}, 'removed': set(), 'updated': {'7e98a342-e446-43cd-a9ad-e1e77aed3807', '2b62c892-4abb-42c7-af27-c6803021dfdd', 'cac42123-50aa-4652-9152-a69ff5b9a35d'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:56:53.889043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'port_id': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'mac_address': 'fa:16:3e:dd:c5:dc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 383, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6978021c-740e-4d5a-a551-8462e322d9a8', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:53.889679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'mac_address': 'fa:16:3e:24:81:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.242'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:53.890364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'mac_address': 'fa:16:3e:fe:e7:63', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:53.895020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 7e98a342-e446-43cd-a9ad-e1e77aed3807 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:53.895509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 7e98a342-e446-43cd-a9ad-e1e77aed3807 updated. Details: {'device': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'port_id': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'mac_address': 'fa:16:3e:dd:c5:dc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 383, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6978021c-740e-4d5a-a551-8462e322d9a8', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 23 00:56:53.896656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e98a342-e4, col_values=(('tag', 8),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.898121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7e98a342-e4, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.898914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7e98a342-e4, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.910704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e98a342-e4, col_values=(('other_config', {'net_uuid': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '383'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.933234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-795eb30c-7f70-493b-a646-031228648727 None None] Resource Port 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:53.933835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-795eb30c-7f70-493b-a646-031228648727 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a49bf77-51b1-4891-aa10-f1dbb529cfe2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:53.940073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ace,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:53.940616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 2b62c892-4abb-42c7-af27-c6803021dfdd {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:53.941104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2b62c892-4abb-42c7-af27-c6803021dfdd updated. Details: {'device': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '2b62c892-4abb-42c7-af27-c6803021dfdd', 'mac_address': 'fa:16:3e:24:81:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.242'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:56:53.942315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2b62c892-4a, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.942871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-2b62c892-4a, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.943427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-2b62c892-4a, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.946834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:53.964162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2b62c892-4a, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:53.965487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:53.978287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ad0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:53.980876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: cac42123-50aa-4652-9152-a69ff5b9a35d {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:53.983260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port cac42123-50aa-4652-9152-a69ff5b9a35d updated. Details: {'device': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'mac_address': 'fa:16:3e:fe:e7:63', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:56:53.983915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 9 as local vlan for net-id=3671536d-8aa1-44fa-b916-8136fb2fa9f6, seg-id=381 Oct 23 00:56:53.990086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211937,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4477), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:53.999872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2ad2,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4105)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4477}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:54.001233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcac42123-50, col_values=(('tag', 9),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:54.003935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapcac42123-50, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:54.004378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapcac42123-50, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:54.015230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcac42123-50, col_values=(('other_config', {'net_uuid': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '381'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:54.032925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ad4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:54.035322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:279 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.147 Oct 23 00:56:54.035896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:56:54.036367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'cac42123-50aa-4652-9152-a69ff5b9a35d'} Oct 23 00:56:54.040940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:54.041461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:54.053075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:56:54.138129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec45e74e-cabc-46cf-ba18-87b2b36a5247]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:56:54.140077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 2 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:56:54.140913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:56:54.143947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:54.144423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:54.150287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:56:54.221865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[c676f96f-0800-42b3-a36e-d71442c9cbe5]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:56:54.222800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:279 - agent port security group processed in 0.334 Oct 23 00:56:54.223810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 7e98a342-e446-43cd-a9ad-e1e77aed3807 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:54.224103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 2b62c892-4abb-42c7-af27-c6803021dfdd to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:54.224387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for cac42123-50aa-4652-9152-a69ff5b9a35d to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:54.383479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-07601ad8-ee4b-4b66-a0e5-1072bf411230 None None] Resource Port cac42123-50aa-4652-9152-a69ff5b9a35d updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:54.384194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-07601ad8-ee4b-4b66-a0e5-1072bf411230 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cac42123-50aa-4652-9152-a69ff5b9a35d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:54.639116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3666d4f5-6341-48fc-9ef2-6110db41822e admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:56:53Z,data_plane_status=None,description='',device_id='53f557d1-b75d-4835-9f36-d774c5942bfc',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=55c9d1b4-a571-45cb-ad61-6353c862fcd6,mac_address=fa:16:3e:4e:1d:29,name='',network_id=3671536d-8aa1-44fa-b916-8136fb2fa9f6,numa_affinity_policy=,project_id='8583a220baac4aa6874e0f5341f87171',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(55c9d1b4-a571-45cb-ad61-6353c862fcd6),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:56:54Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:54.639890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3666d4f5-6341-48fc-9ef2-6110db41822e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (55c9d1b4-a571-45cb-ad61-6353c862fcd6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:54.944066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8edbdde2-00e2-4515-94b1-4913af72fe52","insert","qg-0a49bf77-51",["set",[]],["map",[["attached-mac","fa:16:3e:67:f5:55"],["iface-id","0a49bf77-51b1-4891-aa10-f1dbb529cfe2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:54.987956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8edbdde2-00e2-4515-94b1-4913af72fe52","old",null,["set",[]],null],["","new","qg-0a49bf77-51",22,["map",[["attached-mac","fa:16:3e:67:f5:55"],["iface-id","0a49bf77-51b1-4891-aa10-f1dbb529cfe2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:55.126419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 7e98a342-e446-43cd-a9ad-e1e77aed3807 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:55.126809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (7e98a342-e446-43cd-a9ad-e1e77aed3807), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:55.469972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3666d4f5-6341-48fc-9ef2-6110db41822e admin admin] Received resource Port update without any changes: 55c9d1b4-a571-45cb-ad61-6353c862fcd6 {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:56:55.513402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['7e98a342-e446-43cd-a9ad-e1e77aed3807', '2b62c892-4abb-42c7-af27-c6803021dfdd', 'cac42123-50aa-4652-9152-a69ff5b9a35d'] and devices down [] completed. Oct 23 00:56:55.513920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:279 - ports processed. Elapsed:1.644 Oct 23 00:56:55.514304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:279 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:1.645 Oct 23 00:56:55.871862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:280 started Oct 23 00:56:55.874199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ad6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=945000000,duration_sec=576,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:55.874798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:55.875923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:280 - starting polling. Elapsed:0.004 Oct 23 00:56:55.879499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:55.884794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:280 - port information retrieved. Elapsed:0.013 Oct 23 00:56:55.885730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'0a49bf77-51b1-4891-aa10-f1dbb529cfe2'}, 'removed': set(), 'updated': {'7e98a342-e446-43cd-a9ad-e1e77aed3807', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:56:55.886555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'port_id': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'mac_address': 'fa:16:3e:dd:c5:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 383, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6978021c-740e-4d5a-a551-8462e322d9a8', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:55.887729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'mac_address': 'fa:16:3e:fe:e7:63', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:55.888918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'mac_address': 'fa:16:3e:67:f5:55', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.183'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:55.894315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 7e98a342-e446-43cd-a9ad-e1e77aed3807 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:55.894929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 7e98a342-e446-43cd-a9ad-e1e77aed3807 updated. Details: {'device': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'device_id': '63e9c62b-0504-4d3f-bdb7-d47b057b9cb0', 'network_id': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'port_id': '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'mac_address': 'fa:16:3e:dd:c5:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 383, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6978021c-740e-4d5a-a551-8462e322d9a8', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 23 00:56:55.897805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e98a342-e4, col_values=(('tag', 8),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.898597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7e98a342-e4, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.899073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7e98a342-e4, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.899661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:55.900613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e98a342-e4, col_values=(('other_config', {'net_uuid': '858cf055-6f06-45a9-bd3f-2b834e6b7b79', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '383', 'tag': '8'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.901924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:55.907211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ad8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:55.907978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: cac42123-50aa-4652-9152-a69ff5b9a35d {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:55.908278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port cac42123-50aa-4652-9152-a69ff5b9a35d updated. Details: {'device': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': 'cac42123-50aa-4652-9152-a69ff5b9a35d', 'mac_address': 'fa:16:3e:fe:e7:63', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 23 00:56:55.909730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcac42123-50, col_values=(('tag', 9),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.912197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapcac42123-50, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.913126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapcac42123-50, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.914516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:55.915666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcac42123-50, col_values=(('other_config', {'net_uuid': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '381', 'tag': '9'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.916374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:55.919733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ada,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:55.920246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:55.920820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 updated. Details: {'device': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'mac_address': 'fa:16:3e:67:f5:55', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.183'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:56:55.921703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a49bf77-51, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.922133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0a49bf77-51, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.922575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0a49bf77-51, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.929593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a49bf77-51, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:55.935986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2adc,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:55.936328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:280 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.050 Oct 23 00:56:55.936967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:56:55.937375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'0a49bf77-51b1-4891-aa10-f1dbb529cfe2'} Oct 23 00:56:55.938784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:55.939222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:55.944434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:56:55.981965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cae251-527c-41f4-92a1-e880c11e6ed3]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:56:55.982650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 2 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:56:55.982960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:56:55.984791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:55.985086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:55.990955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:56:56.028358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba0a87-8f86-4fb3-a450-55f197dae6bb]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:56:56.028994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:280 - agent port security group processed in 0.143 Oct 23 00:56:56.029973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 7e98a342-e446-43cd-a9ad-e1e77aed3807 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:56.030265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for cac42123-50aa-4652-9152-a69ff5b9a35d to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:56.030535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:56.606333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:56Z,description='tempest-secgroup-smoke-2035615498 description',id=9e47da15-b648-4e05-8264-514053b0be27,is_default=False,name='tempest-secgroup-smoke-2035615498',project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',revision_number=1,rules=[SecurityGroupRule(0bbf6656-6764-471b-9da9-c538f1038aa1),SecurityGroupRule(54834ade-103f-4850-b396-8593777cad04)],shared=False,stateful=True,updated_at=2022-10-23T00:56:56Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:56.607626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (9e47da15-b648-4e05-8264-514053b0be27), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:56.608492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:56Z,description=,direction='egress',ethertype='IPv4',id=0bbf6656-6764-471b-9da9-c538f1038aa1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:56Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:56.610372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0bbf6656-6764-471b-9da9-c538f1038aa1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:56.610921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:56.611756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:56Z,description=,direction='egress',ethertype='IPv6',id=54834ade-103f-4850-b396-8593777cad04,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:56Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:56.612118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (54834ade-103f-4850-b396-8593777cad04), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:56.612593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-563edadf-b11d-4003-9af9-7d8df5809d65 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:56.626279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['7e98a342-e446-43cd-a9ad-e1e77aed3807', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2'] and devices down [] completed. Oct 23 00:56:56.628558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:280 - ports processed. Elapsed:0.756 Oct 23 00:56:56.629245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:280 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:0.758 Oct 23 00:56:56.719735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0a49bf77-51b1-4891-aa10-f1dbb529cfe2,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:56.720330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a49bf77-51b1-4891-aa10-f1dbb529cfe2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:56.797722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ced4b3c4-4cfa-4e3f-a868-52f42fe1d9c2 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:56Z,description='',direction='ingress',ethertype='IPv4',id=bdc02f66-b6d9-40a1-a307-6aa31e5a8cc5,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:56Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:56.798686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ced4b3c4-4cfa-4e3f-a868-52f42fe1d9c2 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (bdc02f66-b6d9-40a1-a307-6aa31e5a8cc5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:56.799434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ced4b3c4-4cfa-4e3f-a868-52f42fe1d9c2 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:57.058322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b8ccb828-fef0-4224-9412-e13bf90fd617 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:56Z,description='',direction='egress',ethertype='IPv4',id=0d89d567-c52f-479c-aae9-73910f67da9c,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:56Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.066736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b8ccb828-fef0-4224-9412-e13bf90fd617 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0d89d567-c52f-479c-aae9-73910f67da9c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.067104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b8ccb828-fef0-4224-9412-e13bf90fd617 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:57.206954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-627eb7cd-5082-4a57-a391-207bca91cf93 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description='',direction='ingress',ethertype='IPv4',id=e0d763a5-2d2d-4505-a9b9-c59f63db2720,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.207538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-627eb7cd-5082-4a57-a391-207bca91cf93 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e0d763a5-2d2d-4505-a9b9-c59f63db2720), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.208377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-627eb7cd-5082-4a57-a391-207bca91cf93 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:57.373603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8814fe9c-76e0-4cdc-bca4-449c80a8fdbf tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description='',direction='egress',ethertype='IPv4',id=42cf54b2-e8bc-4221-a905-dbf2de8c63fc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.374177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8814fe9c-76e0-4cdc-bca4-449c80a8fdbf tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (42cf54b2-e8bc-4221-a905-dbf2de8c63fc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.374935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8814fe9c-76e0-4cdc-bca4-449c80a8fdbf tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:57.545592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6b7f0657-e874-4837-8ac6-2ab38797875f tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description='',direction='ingress',ethertype='IPv6',id=40a90e16-46e5-4ef6-82a4-2e066713ec59,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.545943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6b7f0657-e874-4837-8ac6-2ab38797875f tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (40a90e16-46e5-4ef6-82a4-2e066713ec59), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.546746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6b7f0657-e874-4837-8ac6-2ab38797875f tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:57.722885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:57Z,description='Default security group',id=dcf63873-b5b0-406f-a224-5f99cfcc5dff,is_default=True,name='default',project_id='afc80e381362477abf8fe895eaaac11a',revision_number=1,rules=[SecurityGroupRule(172faa94-4e48-4d17-8518-cf9d913cc19f),SecurityGroupRule(77e32b21-0a85-4ebf-b0af-56986eaff521),SecurityGroupRule(949cadaf-e81c-4c62-9bb6-fabfd99240f5),SecurityGroupRule(ff8ce4d3-d980-4b4b-a405-aada9f0707be)],shared=False,stateful=True,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.723541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (dcf63873-b5b0-406f-a224-5f99cfcc5dff), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.723854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description=,direction='egress',ethertype='IPv4',id=172faa94-4e48-4d17-8518-cf9d913cc19f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='afc80e381362477abf8fe895eaaac11a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dcf63873-b5b0-406f-a224-5f99cfcc5dff,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.724207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (172faa94-4e48-4d17-8518-cf9d913cc19f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.724533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:57.725235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description=,direction='ingress',ethertype='IPv4',id=77e32b21-0a85-4ebf-b0af-56986eaff521,normalized_cidr=None,port_range_max=,port_range_min=,project_id='afc80e381362477abf8fe895eaaac11a',protocol=,remote_address_group_id=,remote_group_id=dcf63873-b5b0-406f-a224-5f99cfcc5dff,remote_ip_prefix=,revision_number=0,security_group_id=dcf63873-b5b0-406f-a224-5f99cfcc5dff,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.725596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (77e32b21-0a85-4ebf-b0af-56986eaff521), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.725881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:57.726505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description=,direction='egress',ethertype='IPv6',id=949cadaf-e81c-4c62-9bb6-fabfd99240f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='afc80e381362477abf8fe895eaaac11a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dcf63873-b5b0-406f-a224-5f99cfcc5dff,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.727019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (949cadaf-e81c-4c62-9bb6-fabfd99240f5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.727583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:57.728879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description=,direction='ingress',ethertype='IPv6',id=ff8ce4d3-d980-4b4b-a405-aada9f0707be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='afc80e381362477abf8fe895eaaac11a',protocol=,remote_address_group_id=,remote_group_id=dcf63873-b5b0-406f-a224-5f99cfcc5dff,remote_ip_prefix=,revision_number=0,security_group_id=dcf63873-b5b0-406f-a224-5f99cfcc5dff,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.736946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ff8ce4d3-d980-4b4b-a405-aada9f0707be), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.739753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-02b34092-878a-413e-b94e-12e7011c9367 admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:57.772200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-37a9a9e6-903c-4851-b4d4-611ec3dedc79 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:57Z,description='',direction='egress',ethertype='IPv6',id=7c025a3d-fbfd-46cc-bc68-8058230f8c29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e47da15-b648-4e05-8264-514053b0be27,updated_at=2022-10-23T00:56:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:57.772793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-37a9a9e6-903c-4851-b4d4-611ec3dedc79 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7c025a3d-fbfd-46cc-bc68-8058230f8c29), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.773222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-37a9a9e6-903c-4851-b4d4-611ec3dedc79 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 00:56:57.874355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:281 started Oct 23 00:56:57.877912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ade,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=948000000,duration_sec=578,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:57.878588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:57.879020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:281 - starting polling. Elapsed:0.005 Oct 23 00:56:57.882512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.888686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:281 - port information retrieved. Elapsed:0.015 Oct 23 00:56:57.891819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'0a49bf77-51b1-4891-aa10-f1dbb529cfe2'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:56:57.892813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'mac_address': 'fa:16:3e:67:f5:55', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.183'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:57.896846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:57.898555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 updated. Details: {'device': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'mac_address': 'fa:16:3e:67:f5:55', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.183'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:56:57.899924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a49bf77-51, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:57.900590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0a49bf77-51, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:57.901221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0a49bf77-51, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:57.903484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:57.910775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a49bf77-51, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:57.913943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:56:57.923021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ae0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:57.924654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:281 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.031 Oct 23 00:56:57.926821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:56:57.927302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:56:57.929024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:57.930998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:57.938297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:56:57.989716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Resource SecurityGroup deleted: dcf63873-b5b0-406f-a224-5f99cfcc5dff {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:57.990206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (dcf63873-b5b0-406f-a224-5f99cfcc5dff), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:57.990745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dcf63873-b5b0-406f-a224-5f99cfcc5dff',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:58.033728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dcf63873-b5b0-406f-a224-5f99cfcc5dff',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:58.034509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Resource SecurityGroupRule deleted: 172faa94-4e48-4d17-8518-cf9d913cc19f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.035165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (172faa94-4e48-4d17-8518-cf9d913cc19f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.035637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:58.036681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce508e31-2281-4eaa-9261-8137c0eecb43]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:56:58.037363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:281 - agent port security group processed in 0.145 Oct 23 00:56:58.038389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:56:58.040156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Resource SecurityGroupRule deleted: 77e32b21-0a85-4ebf-b0af-56986eaff521 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.040550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (77e32b21-0a85-4ebf-b0af-56986eaff521), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.040958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:58.041386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Resource SecurityGroupRule deleted: 949cadaf-e81c-4c62-9bb6-fabfd99240f5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.041843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (949cadaf-e81c-4c62-9bb6-fabfd99240f5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.042214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:58.042803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Resource SecurityGroupRule deleted: ff8ce4d3-d980-4b4b-a405-aada9f0707be {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.043157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ff8ce4d3-d980-4b4b-a405-aada9f0707be), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.043463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16507b5e-cca1-46ed-8d4f-471fd49a04cc admin admin] Security group rule updated ['dcf63873-b5b0-406f-a224-5f99cfcc5dff'] Oct 23 00:56:58.446389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['0a49bf77-51b1-4891-aa10-f1dbb529cfe2'] and devices down [] completed. Oct 23 00:56:58.447209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:281 - ports processed. Elapsed:0.573 Oct 23 00:56:58.447562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:281 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.574 Oct 23 00:56:58.577721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2f5a7568-1d74-4da2-bae7-abd1b5374bc0 None None] Resource Port 55c9d1b4-a571-45cb-ad61-6353c862fcd6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=55c9d1b4-a571-45cb-ad61-6353c862fcd6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=55c9d1b4-a571-45cb-ad61-6353c862fcd6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:58.578104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2f5a7568-1d74-4da2-bae7-abd1b5374bc0 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (55c9d1b4-a571-45cb-ad61-6353c862fcd6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.583734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:58Z,description='Default security group',id=4a6fd524-8f01-4ac0-b706-42cfbef9607a,is_default=True,name='default',project_id='2fd28732b71b470da7be97c43353cb12',revision_number=1,rules=[SecurityGroupRule(1a91ded6-1898-430f-9877-acb47edfd7de),SecurityGroupRule(8b66879e-d6fa-4e99-94fd-b404270bf280),SecurityGroupRule(b42e5ab0-0cb8-4b3c-bd82-6f62ef2ceeb9),SecurityGroupRule(f51e9c48-7a35-40e4-a939-efdfc1f9a2b4)],shared=False,stateful=True,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.586373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (4a6fd524-8f01-4ac0-b706-42cfbef9607a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.587605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='egress',ethertype='IPv4',id=1a91ded6-1898-430f-9877-acb47edfd7de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fd28732b71b470da7be97c43353cb12',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a6fd524-8f01-4ac0-b706-42cfbef9607a,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.588609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1a91ded6-1898-430f-9877-acb47edfd7de), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.590497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:58.591336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='ingress',ethertype='IPv4',id=8b66879e-d6fa-4e99-94fd-b404270bf280,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fd28732b71b470da7be97c43353cb12',protocol=,remote_address_group_id=,remote_group_id=4a6fd524-8f01-4ac0-b706-42cfbef9607a,remote_ip_prefix=,revision_number=0,security_group_id=4a6fd524-8f01-4ac0-b706-42cfbef9607a,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.594748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8b66879e-d6fa-4e99-94fd-b404270bf280), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.595302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:58.595954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='egress',ethertype='IPv6',id=b42e5ab0-0cb8-4b3c-bd82-6f62ef2ceeb9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fd28732b71b470da7be97c43353cb12',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a6fd524-8f01-4ac0-b706-42cfbef9607a,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.596298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b42e5ab0-0cb8-4b3c-bd82-6f62ef2ceeb9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.596603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:58.600825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='ingress',ethertype='IPv6',id=f51e9c48-7a35-40e4-a939-efdfc1f9a2b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fd28732b71b470da7be97c43353cb12',protocol=,remote_address_group_id=,remote_group_id=4a6fd524-8f01-4ac0-b706-42cfbef9607a,remote_ip_prefix=,revision_number=0,security_group_id=4a6fd524-8f01-4ac0-b706-42cfbef9607a,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.601416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f51e9c48-7a35-40e4-a939-efdfc1f9a2b4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.602108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8d3ca769-2839-4fa8-9a22-e04fe3801f05 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:58.858911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:58Z,description='Default security group',id=b0da7b71-1c58-491d-a87f-2aae643868cd,is_default=True,name='default',project_id='d2eb680057464a288af10bb289c5f4b6',revision_number=1,rules=[SecurityGroupRule(073f2111-5567-4372-97d6-eb4b3d7512c8),SecurityGroupRule(0af3bdcd-1e3e-4d8a-aa39-1e3a6474d1ac),SecurityGroupRule(33e30753-1b72-4d4e-86ed-1a40a21c85b6),SecurityGroupRule(b00273b3-ba16-4b1a-8fef-c950dffd1982)],shared=False,stateful=True,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.859383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b0da7b71-1c58-491d-a87f-2aae643868cd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.860356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='egress',ethertype='IPv4',id=073f2111-5567-4372-97d6-eb4b3d7512c8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d2eb680057464a288af10bb289c5f4b6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b0da7b71-1c58-491d-a87f-2aae643868cd,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.860793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (073f2111-5567-4372-97d6-eb4b3d7512c8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.861866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:58.862489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='ingress',ethertype='IPv6',id=0af3bdcd-1e3e-4d8a-aa39-1e3a6474d1ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d2eb680057464a288af10bb289c5f4b6',protocol=,remote_address_group_id=,remote_group_id=b0da7b71-1c58-491d-a87f-2aae643868cd,remote_ip_prefix=,revision_number=0,security_group_id=b0da7b71-1c58-491d-a87f-2aae643868cd,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.863908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0af3bdcd-1e3e-4d8a-aa39-1e3a6474d1ac), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.864399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:58.865245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='ingress',ethertype='IPv4',id=33e30753-1b72-4d4e-86ed-1a40a21c85b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d2eb680057464a288af10bb289c5f4b6',protocol=,remote_address_group_id=,remote_group_id=b0da7b71-1c58-491d-a87f-2aae643868cd,remote_ip_prefix=,revision_number=0,security_group_id=b0da7b71-1c58-491d-a87f-2aae643868cd,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.865755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (33e30753-1b72-4d4e-86ed-1a40a21c85b6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.866247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:58.869088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:58Z,description=,direction='egress',ethertype='IPv6',id=b00273b3-ba16-4b1a-8fef-c950dffd1982,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d2eb680057464a288af10bb289c5f4b6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b0da7b71-1c58-491d-a87f-2aae643868cd,updated_at=2022-10-23T00:56:58Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:58.869623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b00273b3-ba16-4b1a-8fef-c950dffd1982), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.878860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b16a0b03-4bdc-4957-be2d-d018d7da972d admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:58.890493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2f5a7568-1d74-4da2-bae7-abd1b5374bc0 None None] Resource Port 55c9d1b4-a571-45cb-ad61-6353c862fcd6 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=55c9d1b4-a571-45cb-ad61-6353c862fcd6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=55c9d1b4-a571-45cb-ad61-6353c862fcd6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=55c9d1b4-a571-45cb-ad61-6353c862fcd6,segment=NetworkSegment(e815dbec-503c-49d3-92df-c327e2f51879),segment_id=e815dbec-503c-49d3-92df-c327e2f51879)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:56:58.893175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2f5a7568-1d74-4da2-bae7-abd1b5374bc0 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (55c9d1b4-a571-45cb-ad61-6353c862fcd6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.941389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Resource SecurityGroup deleted: 4a6fd524-8f01-4ac0-b706-42cfbef9607a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.941943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (4a6fd524-8f01-4ac0-b706-42cfbef9607a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.942558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4a6fd524-8f01-4ac0-b706-42cfbef9607a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:58.970137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4a6fd524-8f01-4ac0-b706-42cfbef9607a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:58.970892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Resource SecurityGroupRule deleted: 1a91ded6-1898-430f-9877-acb47edfd7de {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.971413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1a91ded6-1898-430f-9877-acb47edfd7de), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.971981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:58.973058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Resource SecurityGroupRule deleted: 8b66879e-d6fa-4e99-94fd-b404270bf280 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.973800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8b66879e-d6fa-4e99-94fd-b404270bf280), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.974250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:58.975368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Resource SecurityGroupRule deleted: b42e5ab0-0cb8-4b3c-bd82-6f62ef2ceeb9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.975849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b42e5ab0-0cb8-4b3c-bd82-6f62ef2ceeb9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.976620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:58.977149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Resource SecurityGroupRule deleted: f51e9c48-7a35-40e4-a939-efdfc1f9a2b4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:58.978107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f51e9c48-7a35-40e4-a939-efdfc1f9a2b4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:58.978569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8cbb9f5c-279b-496e-bd2b-4b265cf9cbe5 admin admin] Security group rule updated ['4a6fd524-8f01-4ac0-b706-42cfbef9607a'] Oct 23 00:56:59.121087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Resource SecurityGroup deleted: b0da7b71-1c58-491d-a87f-2aae643868cd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.123647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b0da7b71-1c58-491d-a87f-2aae643868cd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.125295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b0da7b71-1c58-491d-a87f-2aae643868cd',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:59.170875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b0da7b71-1c58-491d-a87f-2aae643868cd',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:59.171580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Resource SecurityGroupRule deleted: 073f2111-5567-4372-97d6-eb4b3d7512c8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.171950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (073f2111-5567-4372-97d6-eb4b3d7512c8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.172372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:59.173226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Resource SecurityGroupRule deleted: 0af3bdcd-1e3e-4d8a-aa39-1e3a6474d1ac {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.174049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0af3bdcd-1e3e-4d8a-aa39-1e3a6474d1ac), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.175054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:59.175931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Resource SecurityGroupRule deleted: 33e30753-1b72-4d4e-86ed-1a40a21c85b6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.176614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (33e30753-1b72-4d4e-86ed-1a40a21c85b6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.177096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:59.177600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Resource SecurityGroupRule deleted: b00273b3-ba16-4b1a-8fef-c950dffd1982 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.178073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b00273b3-ba16-4b1a-8fef-c950dffd1982), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.178780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0ed57be1-6941-42b2-b0fd-13e1a66ea1e8 admin admin] Security group rule updated ['b0da7b71-1c58-491d-a87f-2aae643868cd'] Oct 23 00:56:59.314619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8fb24a18-dd4d-40fd-a2f3-33d8bd8a652b","insert","qr-55c9d1b4-a5",["set",[]],["map",[["attached-mac","fa:16:3e:4e:1d:29"],["iface-id","55c9d1b4-a571-45cb-ad61-6353c862fcd6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:59.338160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8fb24a18-dd4d-40fd-a2f3-33d8bd8a652b","old",null,["set",[]],null],["","new","qr-55c9d1b4-a5",23,["map",[["attached-mac","fa:16:3e:4e:1d:29"],["iface-id","55c9d1b4-a571-45cb-ad61-6353c862fcd6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:56:59.529961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:56:59Z,description='Default security group',id=550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd,is_default=True,name='default',project_id='4d51f7bdb454425298cda17703f01476',revision_number=1,rules=[SecurityGroupRule(1358181b-6b56-4018-b0f6-3f2d56e1d9a9),SecurityGroupRule(690ff955-fe26-40ed-8dc7-0b472ead1097),SecurityGroupRule(6be4d225-dbbe-4316-bdf5-aaa0b8751569),SecurityGroupRule(ee451662-1216-4f8f-a2c1-831ad1820929)],shared=False,stateful=True,updated_at=2022-10-23T00:56:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:59.531716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.533005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:59Z,description=,direction='egress',ethertype='IPv4',id=1358181b-6b56-4018-b0f6-3f2d56e1d9a9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4d51f7bdb454425298cda17703f01476',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd,updated_at=2022-10-23T00:56:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:59.534617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1358181b-6b56-4018-b0f6-3f2d56e1d9a9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.535992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.536691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:59Z,description=,direction='egress',ethertype='IPv6',id=690ff955-fe26-40ed-8dc7-0b472ead1097,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4d51f7bdb454425298cda17703f01476',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd,updated_at=2022-10-23T00:56:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:59.537073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (690ff955-fe26-40ed-8dc7-0b472ead1097), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.537395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.545133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:59Z,description=,direction='ingress',ethertype='IPv6',id=6be4d225-dbbe-4316-bdf5-aaa0b8751569,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4d51f7bdb454425298cda17703f01476',protocol=,remote_address_group_id=,remote_group_id=550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd,remote_ip_prefix=,revision_number=0,security_group_id=550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd,updated_at=2022-10-23T00:56:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:59.545741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6be4d225-dbbe-4316-bdf5-aaa0b8751569), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.546143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.547142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:56:59Z,description=,direction='ingress',ethertype='IPv4',id=ee451662-1216-4f8f-a2c1-831ad1820929,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4d51f7bdb454425298cda17703f01476',protocol=,remote_address_group_id=,remote_group_id=550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd,remote_ip_prefix=,revision_number=0,security_group_id=550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd,updated_at=2022-10-23T00:56:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:56:59.547588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ee451662-1216-4f8f-a2c1-831ad1820929), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.549528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e58ce73-b16f-4d3d-bfe6-0612560f7117 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.820402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Resource SecurityGroup deleted: 550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.820826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.821600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:56:59.842383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:56:59.843106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Resource SecurityGroupRule deleted: 1358181b-6b56-4018-b0f6-3f2d56e1d9a9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.843717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1358181b-6b56-4018-b0f6-3f2d56e1d9a9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.844227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.844835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Resource SecurityGroupRule deleted: 690ff955-fe26-40ed-8dc7-0b472ead1097 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.845346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (690ff955-fe26-40ed-8dc7-0b472ead1097), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.846920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.846920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Resource SecurityGroupRule deleted: 6be4d225-dbbe-4316-bdf5-aaa0b8751569 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.846920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6be4d225-dbbe-4316-bdf5-aaa0b8751569), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.847272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.849055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Resource SecurityGroupRule deleted: ee451662-1216-4f8f-a2c1-831ad1820929 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:56:59.849609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ee451662-1216-4f8f-a2c1-831ad1820929), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.850260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6bc50525-0b72-4a66-8017-8ce5b56bdfa4 admin admin] Security group rule updated ['550647c1-4ed6-4663-bfa1-ae1c5bc1d4fd'] Oct 23 00:56:59.875388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:282 started Oct 23 00:56:59.878221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ae2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=949000000,duration_sec=580,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:59.879116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:56:59.880417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:282 - starting polling. Elapsed:0.005 Oct 23 00:56:59.884538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:56:59.894115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:282 - port information retrieved. Elapsed:0.019 Oct 23 00:56:59.897196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'55c9d1b4-a571-45cb-ad61-6353c862fcd6'}, 'removed': set(), 'updated': {'55c9d1b4-a571-45cb-ad61-6353c862fcd6'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:56:59.899046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'mac_address': 'fa:16:3e:4e:1d:29', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:56:59.911520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 55c9d1b4-a571-45cb-ad61-6353c862fcd6 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:56:59.911866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 55c9d1b4-a571-45cb-ad61-6353c862fcd6 updated. Details: {'device': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'mac_address': 'fa:16:3e:4e:1d:29', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 23 00:56:59.916325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-55c9d1b4-a5, col_values=(('tag', 9),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:59.916824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-55c9d1b4-a5, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:59.917256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-55c9d1b4-a5, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:59.924244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-55c9d1b4-a5, col_values=(('other_config', {'net_uuid': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '381'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:56:59.946354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ae4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:56:59.947013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:282 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.049 Oct 23 00:56:59.948577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:56:59.948974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'55c9d1b4-a571-45cb-ad61-6353c862fcd6'} Oct 23 00:56:59.952097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:56:59.953554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:56:59.959315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:00.015066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b54bf3-cad0-41ab-815e-0ef0a8ff837d]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:00.015701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:282 - agent port security group processed in 0.118 Oct 23 00:57:00.016550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 55c9d1b4-a571-45cb-ad61-6353c862fcd6 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:00.251499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['55c9d1b4-a571-45cb-ad61-6353c862fcd6'] and devices down [] completed. Oct 23 00:57:00.252031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:282 - ports processed. Elapsed:0.377 Oct 23 00:57:00.255742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:282 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.380 Oct 23 00:57:00.307471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 55c9d1b4-a571-45cb-ad61-6353c862fcd6 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:00.307916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (55c9d1b4-a571-45cb-ad61-6353c862fcd6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:01.876495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:283 started Oct 23 00:57:01.878987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ae6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=950000000,duration_sec=582,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:01.879695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:01.880029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:283 - starting polling. Elapsed:0.004 Oct 23 00:57:01.882970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:01.890162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:283 - port information retrieved. Elapsed:0.014 Oct 23 00:57:01.890541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '1af047de-df31-40f1-8ab4-6afa1a4ee2ae', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'55c9d1b4-a571-45cb-ad61-6353c862fcd6'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:01.891064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'mac_address': 'fa:16:3e:4e:1d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:01.901906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 55c9d1b4-a571-45cb-ad61-6353c862fcd6 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:01.902242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 55c9d1b4-a571-45cb-ad61-6353c862fcd6 updated. Details: {'device': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'device_id': '53f557d1-b75d-4835-9f36-d774c5942bfc', 'network_id': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'port_id': '55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'mac_address': 'fa:16:3e:4e:1d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0fa7088a-c070-4968-8e67-305bb07f64cf', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 23 00:57:01.904158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-55c9d1b4-a5, col_values=(('tag', 9),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:01.904553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-55c9d1b4-a5, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:01.905167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-55c9d1b4-a5, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:01.905795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:01.906935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-55c9d1b4-a5, col_values=(('other_config', {'net_uuid': '3671536d-8aa1-44fa-b916-8136fb2fa9f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '381', 'tag': '9'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:01.907502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:01.910968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ae8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:01.911539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:283 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.021 Oct 23 00:57:01.912072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:57:01.912648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:57:01.914550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:01.915055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:01.920919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:01.995681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046df5e-3f6f-4daa-a5f9-8ff1ee3713f5]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:01.996967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:283 - agent port security group processed in 0.106 Oct 23 00:57:01.998021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 55c9d1b4-a571-45cb-ad61-6353c862fcd6 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:02.181251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['55c9d1b4-a571-45cb-ad61-6353c862fcd6'] and devices down [] completed. Oct 23 00:57:02.181686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:283 - ports processed. Elapsed:0.305 Oct 23 00:57:02.182091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:283 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.306 Oct 23 00:57:02.550109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port eaf96dfe-f805-4be4-9d2f-7507301823d2 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:02.550507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (eaf96dfe-f805-4be4-9d2f-7507301823d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:03.877850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:284 started Oct 23 00:57:03.880534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=951000000,duration_sec=584,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:03.881232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:03.881647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:284 - starting polling. Elapsed:0.004 Oct 23 00:57:03.884780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:03.889090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:284 - port information retrieved. Elapsed:0.011 Oct 23 00:57:03.889493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:284 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:57:05.878799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:285 started Oct 23 00:57:05.881907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=952000000,duration_sec=586,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:05.882502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:05.882858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:285 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:07.880075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:286 started Oct 23 00:57:07.882723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2aee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=953000000,duration_sec=588,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:07.883300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:07.883678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:286 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:08.062556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e652fb24-e628-48a9-84d8-cf6209435054 tempest-DeleteServersTestJSON-44257626 tempest-DeleteServersTestJSON-44257626-project] Resource Port deleted: eaf96dfe-f805-4be4-9d2f-7507301823d2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:08.063021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e652fb24-e628-48a9-84d8-cf6209435054 tempest-DeleteServersTestJSON-44257626 tempest-DeleteServersTestJSON-44257626-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (eaf96dfe-f805-4be4-9d2f-7507301823d2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:08.063667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e652fb24-e628-48a9-84d8-cf6209435054 tempest-DeleteServersTestJSON-44257626 tempest-DeleteServersTestJSON-44257626-project] Security group member updated {'f3ce37d9-177c-4e87-927f-4bd88426ffae'} Oct 23 00:57:09.881109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:287 started Oct 23 00:57:09.883794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2af0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=955000000,duration_sec=590,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:09.884529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:09.884968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:287 - starting polling. Elapsed:0.004 Oct 23 00:57:09.888166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:09.890301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port eaf96dfe-f805-4be4-9d2f-7507301823d2 not present in bridge br-int Oct 23 00:57:09.890953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 00:57:09.891275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['eaf96dfe-f805-4be4-9d2f-7507301823d2'] Oct 23 00:57:09.891606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port eaf96dfe-f805-4be4-9d2f-7507301823d2 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 00:57:09.895658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:287 - port information retrieved. Elapsed:0.015 Oct 23 00:57:09.896050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:287 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 23 00:57:11.881508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:288 started Oct 23 00:57:11.884030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2af2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=955000000,duration_sec=592,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:11.884613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:11.885010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:288 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:13.717223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:13Z,description='Default security group',id=b8dc9038-2591-400b-a2f6-8d1392420069,is_default=True,name='default',project_id='bb4dcacd7f04402aa45b2c1545ddc1b7',revision_number=1,rules=[SecurityGroupRule(40ce28a3-d3c0-4b82-add8-7a8b5ba3b141),SecurityGroupRule(7b41409f-884e-4c74-bddb-e938ead6d375),SecurityGroupRule(b71e0138-a324-4e50-bfa0-ebeeb252a920),SecurityGroupRule(d404f53a-c145-4612-ae08-cb458fa99470)],shared=False,stateful=True,updated_at=2022-10-23T00:57:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:13.717864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b8dc9038-2591-400b-a2f6-8d1392420069), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.718304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:13Z,description=,direction='egress',ethertype='IPv6',id=40ce28a3-d3c0-4b82-add8-7a8b5ba3b141,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb4dcacd7f04402aa45b2c1545ddc1b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8dc9038-2591-400b-a2f6-8d1392420069,updated_at=2022-10-23T00:57:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:13.718656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (40ce28a3-d3c0-4b82-add8-7a8b5ba3b141), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.718983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:13.719638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:13Z,description=,direction='egress',ethertype='IPv4',id=7b41409f-884e-4c74-bddb-e938ead6d375,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb4dcacd7f04402aa45b2c1545ddc1b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8dc9038-2591-400b-a2f6-8d1392420069,updated_at=2022-10-23T00:57:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:13.719978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7b41409f-884e-4c74-bddb-e938ead6d375), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.720296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:13.720950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:13Z,description=,direction='ingress',ethertype='IPv6',id=b71e0138-a324-4e50-bfa0-ebeeb252a920,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb4dcacd7f04402aa45b2c1545ddc1b7',protocol=,remote_address_group_id=,remote_group_id=b8dc9038-2591-400b-a2f6-8d1392420069,remote_ip_prefix=,revision_number=0,security_group_id=b8dc9038-2591-400b-a2f6-8d1392420069,updated_at=2022-10-23T00:57:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:13.721290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b71e0138-a324-4e50-bfa0-ebeeb252a920), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.721605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:13.722241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:13Z,description=,direction='ingress',ethertype='IPv4',id=d404f53a-c145-4612-ae08-cb458fa99470,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb4dcacd7f04402aa45b2c1545ddc1b7',protocol=,remote_address_group_id=,remote_group_id=b8dc9038-2591-400b-a2f6-8d1392420069,remote_ip_prefix=,revision_number=0,security_group_id=b8dc9038-2591-400b-a2f6-8d1392420069,updated_at=2022-10-23T00:57:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:13.722585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d404f53a-c145-4612-ae08-cb458fa99470), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.722894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d86f1f0-4b14-431e-83e4-cf9b8fa3cf30 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:13.869637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Resource SecurityGroup deleted: b8dc9038-2591-400b-a2f6-8d1392420069 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:13.870119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b8dc9038-2591-400b-a2f6-8d1392420069), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.870890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b8dc9038-2591-400b-a2f6-8d1392420069',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:13.882733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:289 started Oct 23 00:57:13.886837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2af4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=956000000,duration_sec=594,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:13.888105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:13.888563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:289 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:57:13.899300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b8dc9038-2591-400b-a2f6-8d1392420069',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:13.900046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Resource SecurityGroupRule deleted: 40ce28a3-d3c0-4b82-add8-7a8b5ba3b141 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:13.900610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (40ce28a3-d3c0-4b82-add8-7a8b5ba3b141), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.900972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:13.901399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Resource SecurityGroupRule deleted: 7b41409f-884e-4c74-bddb-e938ead6d375 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:13.902126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7b41409f-884e-4c74-bddb-e938ead6d375), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.902434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:13.903472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Resource SecurityGroupRule deleted: b71e0138-a324-4e50-bfa0-ebeeb252a920 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:13.903996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b71e0138-a324-4e50-bfa0-ebeeb252a920), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.904316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:13.904662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Resource SecurityGroupRule deleted: d404f53a-c145-4612-ae08-cb458fa99470 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:13.905184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d404f53a-c145-4612-ae08-cb458fa99470), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:13.905502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1498e209-b6d6-4c3a-a07d-31badbf41f09 admin admin] Security group rule updated ['b8dc9038-2591-400b-a2f6-8d1392420069'] Oct 23 00:57:14.329409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:14Z,description='Default security group',id=923a9f14-ec0f-44db-a801-14852ca788c9,is_default=True,name='default',project_id='f392c797e769438a9356c5d0dcdee406',revision_number=1,rules=[SecurityGroupRule(113587eb-dcf1-4951-995e-418645a68d69),SecurityGroupRule(3f4c468c-9074-400a-966b-8999c0434615),SecurityGroupRule(920ca19b-eec6-4cc4-9836-bced8517f09d),SecurityGroupRule(f13d33d7-6a39-4043-85f6-48e2e3564087)],shared=False,stateful=True,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:14.329889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (923a9f14-ec0f-44db-a801-14852ca788c9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.330725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='ingress',ethertype='IPv6',id=113587eb-dcf1-4951-995e-418645a68d69,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f392c797e769438a9356c5d0dcdee406',protocol=,remote_address_group_id=,remote_group_id=923a9f14-ec0f-44db-a801-14852ca788c9,remote_ip_prefix=,revision_number=0,security_group_id=923a9f14-ec0f-44db-a801-14852ca788c9,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:14.331267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (113587eb-dcf1-4951-995e-418645a68d69), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.331769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:14.332634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='ingress',ethertype='IPv4',id=3f4c468c-9074-400a-966b-8999c0434615,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f392c797e769438a9356c5d0dcdee406',protocol=,remote_address_group_id=,remote_group_id=923a9f14-ec0f-44db-a801-14852ca788c9,remote_ip_prefix=,revision_number=0,security_group_id=923a9f14-ec0f-44db-a801-14852ca788c9,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:14.332984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3f4c468c-9074-400a-966b-8999c0434615), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.333446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:14.334226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='egress',ethertype='IPv4',id=920ca19b-eec6-4cc4-9836-bced8517f09d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f392c797e769438a9356c5d0dcdee406',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=923a9f14-ec0f-44db-a801-14852ca788c9,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:14.334573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (920ca19b-eec6-4cc4-9836-bced8517f09d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.334904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:14.335721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=f13d33d7-6a39-4043-85f6-48e2e3564087,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f392c797e769438a9356c5d0dcdee406',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=923a9f14-ec0f-44db-a801-14852ca788c9,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:14.336284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f13d33d7-6a39-4043-85f6-48e2e3564087), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.336797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9ad740b4-9031-437b-b4fa-08f1582bcf3e admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:14.473237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Resource SecurityGroup deleted: 923a9f14-ec0f-44db-a801-14852ca788c9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:14.473626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (923a9f14-ec0f-44db-a801-14852ca788c9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.474059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('923a9f14-ec0f-44db-a801-14852ca788c9',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:14.497686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('923a9f14-ec0f-44db-a801-14852ca788c9',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:14.498702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Resource SecurityGroupRule deleted: 113587eb-dcf1-4951-995e-418645a68d69 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:14.499457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (113587eb-dcf1-4951-995e-418645a68d69), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.500427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:14.501119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Resource SecurityGroupRule deleted: 3f4c468c-9074-400a-966b-8999c0434615 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:14.502056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3f4c468c-9074-400a-966b-8999c0434615), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.502561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:14.503961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Resource SecurityGroupRule deleted: 920ca19b-eec6-4cc4-9836-bced8517f09d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:14.504863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (920ca19b-eec6-4cc4-9836-bced8517f09d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.505357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:14.506134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Resource SecurityGroupRule deleted: f13d33d7-6a39-4043-85f6-48e2e3564087 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:14.506858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f13d33d7-6a39-4043-85f6-48e2e3564087), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:14.507436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c6b3a11a-7850-4d7a-b535-37300952d983 admin admin] Security group rule updated ['923a9f14-ec0f-44db-a801-14852ca788c9'] Oct 23 00:57:15.021183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:14Z,description='Default security group',id=5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7,is_default=True,name='default',project_id='f10ad9162e69451b835a7e9a77804249',revision_number=1,rules=[SecurityGroupRule(5cb23ea3-6647-4383-9264-9016051a8eda),SecurityGroupRule(68bb2633-d738-49a5-8dc6-a57f8b3a127e),SecurityGroupRule(9fef9b95-c828-496f-9e51-181f1dac9fdf),SecurityGroupRule(c1f894a2-411c-4e57-bbd8-a9126c5d1c2e)],shared=False,stateful=True,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:15.021937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.023325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='egress',ethertype='IPv4',id=5cb23ea3-6647-4383-9264-9016051a8eda,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f10ad9162e69451b835a7e9a77804249',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:15.023797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5cb23ea3-6647-4383-9264-9016051a8eda), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.024171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.024944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='ingress',ethertype='IPv4',id=68bb2633-d738-49a5-8dc6-a57f8b3a127e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f10ad9162e69451b835a7e9a77804249',protocol=,remote_address_group_id=,remote_group_id=5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7,remote_ip_prefix=,revision_number=0,security_group_id=5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:15.025577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (68bb2633-d738-49a5-8dc6-a57f8b3a127e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.025945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.026646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='ingress',ethertype='IPv6',id=9fef9b95-c828-496f-9e51-181f1dac9fdf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f10ad9162e69451b835a7e9a77804249',protocol=,remote_address_group_id=,remote_group_id=5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7,remote_ip_prefix=,revision_number=0,security_group_id=5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:15.026982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9fef9b95-c828-496f-9e51-181f1dac9fdf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.027629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.028953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=c1f894a2-411c-4e57-bbd8-a9126c5d1c2e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f10ad9162e69451b835a7e9a77804249',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7,updated_at=2022-10-23T00:57:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:15.029305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c1f894a2-411c-4e57-bbd8-a9126c5d1c2e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.029648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a67738d5-e3c9-4861-acf3-979e044b0377 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.132857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e7ebab58-b758-4bfe-99a2-57b4b48ce8e7 admin admin] Resource Port deleted: 1af047de-df31-40f1-8ab4-6afa1a4ee2ae {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:15.133359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e7ebab58-b758-4bfe-99a2-57b4b48ce8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (1af047de-df31-40f1-8ab4-6afa1a4ee2ae), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.163569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Resource SecurityGroup deleted: 5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:15.164132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.164798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:15.179783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:15.180497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Resource SecurityGroupRule deleted: 5cb23ea3-6647-4383-9264-9016051a8eda {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:15.181129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5cb23ea3-6647-4383-9264-9016051a8eda), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.181685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.182081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Resource SecurityGroupRule deleted: 68bb2633-d738-49a5-8dc6-a57f8b3a127e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:15.182420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (68bb2633-d738-49a5-8dc6-a57f8b3a127e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.182854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.183225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Resource SecurityGroupRule deleted: 9fef9b95-c828-496f-9e51-181f1dac9fdf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:15.183583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9fef9b95-c828-496f-9e51-181f1dac9fdf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.184083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.184751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Resource SecurityGroupRule deleted: c1f894a2-411c-4e57-bbd8-a9126c5d1c2e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:15.190313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c1f894a2-411c-4e57-bbd8-a9126c5d1c2e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.191020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-11830cf7-55ea-411c-8bde-b0b347166386 admin admin] Security group rule updated ['5eb01d8d-af94-4664-ae3b-e4a4b6e2dbe7'] Oct 23 00:57:15.883988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:290 started Oct 23 00:57:15.887597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2af6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=958000000,duration_sec=596,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:15.888204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:15.888848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:290 - starting polling. Elapsed:0.005 Oct 23 00:57:15.892041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:15.897575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1af047de-df, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:15.920994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2af8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:15.924942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['1af047de-df31-40f1-8ab4-6afa1a4ee2ae'] Oct 23 00:57:15.925627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:16.029109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff864ee-21d6-4a31-91ef-a04d5eb8d05f]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:16.033666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:290 - port information retrieved. Elapsed:0.150 Oct 23 00:57:16.034276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:290 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.150 Oct 23 00:57:16.055316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:15Z,description='Default security group',id=18b9338c-0f30-4be9-a49c-bb68d78d6b40,is_default=True,name='default',project_id='1e67aeea21404e4882a1c0008a4f7a62',revision_number=1,rules=[SecurityGroupRule(1a1ef1cc-f090-4f75-81de-ba16cf476a6c),SecurityGroupRule(3f50153b-5df6-48fb-bc6a-a40ae4d894bb),SecurityGroupRule(b231454e-d7d1-4ad2-a3c5-206925cd7611),SecurityGroupRule(fd3f15b0-3694-4746-a0bf-16a7a9d73b4f)],shared=False,stateful=True,updated_at=2022-10-23T00:57:15Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:16.055802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (18b9338c-0f30-4be9-a49c-bb68d78d6b40), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.056648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:15Z,description=,direction='ingress',ethertype='IPv6',id=1a1ef1cc-f090-4f75-81de-ba16cf476a6c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e67aeea21404e4882a1c0008a4f7a62',protocol=,remote_address_group_id=,remote_group_id=18b9338c-0f30-4be9-a49c-bb68d78d6b40,remote_ip_prefix=,revision_number=0,security_group_id=18b9338c-0f30-4be9-a49c-bb68d78d6b40,updated_at=2022-10-23T00:57:15Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:16.058149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1a1ef1cc-f090-4f75-81de-ba16cf476a6c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.058514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:16.059631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:15Z,description=,direction='egress',ethertype='IPv6',id=3f50153b-5df6-48fb-bc6a-a40ae4d894bb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e67aeea21404e4882a1c0008a4f7a62',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=18b9338c-0f30-4be9-a49c-bb68d78d6b40,updated_at=2022-10-23T00:57:15Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:16.060158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3f50153b-5df6-48fb-bc6a-a40ae4d894bb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.061105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:16.061804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:15Z,description=,direction='ingress',ethertype='IPv4',id=b231454e-d7d1-4ad2-a3c5-206925cd7611,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e67aeea21404e4882a1c0008a4f7a62',protocol=,remote_address_group_id=,remote_group_id=18b9338c-0f30-4be9-a49c-bb68d78d6b40,remote_ip_prefix=,revision_number=0,security_group_id=18b9338c-0f30-4be9-a49c-bb68d78d6b40,updated_at=2022-10-23T00:57:15Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:16.062163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b231454e-d7d1-4ad2-a3c5-206925cd7611), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.062581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:16.063257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:15Z,description=,direction='egress',ethertype='IPv4',id=fd3f15b0-3694-4746-a0bf-16a7a9d73b4f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e67aeea21404e4882a1c0008a4f7a62',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=18b9338c-0f30-4be9-a49c-bb68d78d6b40,updated_at=2022-10-23T00:57:15Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:16.063615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fd3f15b0-3694-4746-a0bf-16a7a9d73b4f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.063945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-75faebf0-07e9-4cdb-90d9-e9d447ed8459 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:16.557061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Resource SecurityGroup deleted: 18b9338c-0f30-4be9-a49c-bb68d78d6b40 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:16.557525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (18b9338c-0f30-4be9-a49c-bb68d78d6b40), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.558378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('18b9338c-0f30-4be9-a49c-bb68d78d6b40',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:16.576578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('18b9338c-0f30-4be9-a49c-bb68d78d6b40',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:16.577110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Resource SecurityGroupRule deleted: 1a1ef1cc-f090-4f75-81de-ba16cf476a6c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:16.577483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1a1ef1cc-f090-4f75-81de-ba16cf476a6c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.577984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:16.578663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Resource SecurityGroupRule deleted: 3f50153b-5df6-48fb-bc6a-a40ae4d894bb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:16.579372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3f50153b-5df6-48fb-bc6a-a40ae4d894bb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.579703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:16.580069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Resource SecurityGroupRule deleted: b231454e-d7d1-4ad2-a3c5-206925cd7611 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:16.580413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b231454e-d7d1-4ad2-a3c5-206925cd7611), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.580748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:16.581122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Resource SecurityGroupRule deleted: fd3f15b0-3694-4746-a0bf-16a7a9d73b4f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:16.581466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fd3f15b0-3694-4746-a0bf-16a7a9d73b4f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:16.581778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d87a7d40-851b-4f2c-8fac-2008fa0408e3 admin admin] Security group rule updated ['18b9338c-0f30-4be9-a49c-bb68d78d6b40'] Oct 23 00:57:17.243966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8301d26e-43db-4ba1-9ef4-b6af7401f3ea admin admin] Resource Port deleted: cfbaf355-dc65-4e70-a31f-49dfe300f3d3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:17.245207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8301d26e-43db-4ba1-9ef4-b6af7401f3ea admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (cfbaf355-dc65-4e70-a31f-49dfe300f3d3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.381390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:17Z,description='Default security group',id=3b45f778-86c3-4766-8d0e-e41b0286c7c1,is_default=True,name='default',project_id='bbab435ea9c8494e9814a6e0d34f305a',revision_number=1,rules=[SecurityGroupRule(587f2037-4c2b-41fd-accd-f1ea89ac231c),SecurityGroupRule(7b779227-3654-4236-9ca1-e2f695b7d28d),SecurityGroupRule(844986cc-f724-4bff-aaf4-171b33d64aae),SecurityGroupRule(e67bdd7c-952d-4af7-9bc9-e8daf7a0cd97)],shared=False,stateful=True,updated_at=2022-10-23T00:57:17Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:17.382005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (3b45f778-86c3-4766-8d0e-e41b0286c7c1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.383021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:17Z,description=,direction='ingress',ethertype='IPv6',id=587f2037-4c2b-41fd-accd-f1ea89ac231c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bbab435ea9c8494e9814a6e0d34f305a',protocol=,remote_address_group_id=,remote_group_id=3b45f778-86c3-4766-8d0e-e41b0286c7c1,remote_ip_prefix=,revision_number=0,security_group_id=3b45f778-86c3-4766-8d0e-e41b0286c7c1,updated_at=2022-10-23T00:57:17Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:17.383790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (587f2037-4c2b-41fd-accd-f1ea89ac231c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.384654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.386300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:17Z,description=,direction='egress',ethertype='IPv6',id=7b779227-3654-4236-9ca1-e2f695b7d28d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bbab435ea9c8494e9814a6e0d34f305a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3b45f778-86c3-4766-8d0e-e41b0286c7c1,updated_at=2022-10-23T00:57:17Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:17.386861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7b779227-3654-4236-9ca1-e2f695b7d28d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.387369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.388181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:17Z,description=,direction='egress',ethertype='IPv4',id=844986cc-f724-4bff-aaf4-171b33d64aae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bbab435ea9c8494e9814a6e0d34f305a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3b45f778-86c3-4766-8d0e-e41b0286c7c1,updated_at=2022-10-23T00:57:17Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:17.388872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (844986cc-f724-4bff-aaf4-171b33d64aae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.390763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.391985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:17Z,description=,direction='ingress',ethertype='IPv4',id=e67bdd7c-952d-4af7-9bc9-e8daf7a0cd97,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bbab435ea9c8494e9814a6e0d34f305a',protocol=,remote_address_group_id=,remote_group_id=3b45f778-86c3-4766-8d0e-e41b0286c7c1,remote_ip_prefix=,revision_number=0,security_group_id=3b45f778-86c3-4766-8d0e-e41b0286c7c1,updated_at=2022-10-23T00:57:17Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:17.393000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e67bdd7c-952d-4af7-9bc9-e8daf7a0cd97), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.395303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-edd4fe8e-d939-47bc-8e08-9cccb1753b78 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.501861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["25226760-e5e1-442c-8dd8-e5708f79b689","delete","qr-1af047de-df",15,["map",[["attached-mac","fa:16:3e:89:e0:2c"],["iface-id","1af047de-df31-40f1-8ab4-6afa1a4ee2ae"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:17.632687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Resource SecurityGroup deleted: 3b45f778-86c3-4766-8d0e-e41b0286c7c1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:17.633354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (3b45f778-86c3-4766-8d0e-e41b0286c7c1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.634041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3b45f778-86c3-4766-8d0e-e41b0286c7c1',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:17.650771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3b45f778-86c3-4766-8d0e-e41b0286c7c1',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:17.651535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Resource SecurityGroupRule deleted: 587f2037-4c2b-41fd-accd-f1ea89ac231c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:17.652576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (587f2037-4c2b-41fd-accd-f1ea89ac231c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.653117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.653522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Resource SecurityGroupRule deleted: 7b779227-3654-4236-9ca1-e2f695b7d28d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:17.653872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7b779227-3654-4236-9ca1-e2f695b7d28d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.654193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.654564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Resource SecurityGroupRule deleted: 844986cc-f724-4bff-aaf4-171b33d64aae {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:17.654978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (844986cc-f724-4bff-aaf4-171b33d64aae), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.655422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.655787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Resource SecurityGroupRule deleted: e67bdd7c-952d-4af7-9bc9-e8daf7a0cd97 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:17.656369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e67bdd7c-952d-4af7-9bc9-e8daf7a0cd97), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.656876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-781fe563-5db5-4275-b386-86e145ead371 admin admin] Security group rule updated ['3b45f778-86c3-4766-8d0e-e41b0286c7c1'] Oct 23 00:57:17.886097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:291 started Oct 23 00:57:17.891467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2afa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=960000000,duration_sec=598,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:17.892591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:17.894094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:291 - starting polling. Elapsed:0.007 Oct 23 00:57:17.899021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:17.903831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-cfbaf355-dc, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:17.918686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2afc,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:17.920649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['cfbaf355-dc65-4e70-a31f-49dfe300f3d3'] Oct 23 00:57:17.921535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:17.966616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[515e5c5c-31fb-4bec-b228-c1f64f27c6bf]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:17.975306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa8a8b2a-251a-4c96-a208-fadcc3751dd9","delete","qg-cfbaf355-dc",7,["map",[["attached-mac","fa:16:3e:6d:af:6d"],["iface-id","cfbaf355-dc65-4e70-a31f-49dfe300f3d3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:17.976628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2afe,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:17.977786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:291 - port information retrieved. Elapsed:0.091 Oct 23 00:57:17.978372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '81a4888a-a035-4442-91ea-dd123a7c1c39', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': {'1af047de-df31-40f1-8ab4-6afa1a4ee2ae'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:17.978952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:291 - agent port security group processed in 0.000 Oct 23 00:57:17.982367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 00:57:17.982772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'1af047de-df31-40f1-8ab4-6afa1a4ee2ae'} Oct 23 00:57:17.983200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 1af047de-df31-40f1-8ab4-6afa1a4ee2ae is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 00:57:17.983592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'1af047de-df31-40f1-8ab4-6afa1a4ee2ae'} removed Oct 23 00:57:18.018718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 00:57:18.019085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 00:57:18.019440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:291 - treat_devices_removed completed in 0.037 Oct 23 00:57:18.019746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:291 - ports processed. Elapsed:0.134 Oct 23 00:57:18.019992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:291 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.134 Oct 23 00:57:18.179867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-03d81ee3-27a6-4de4-b999-7328a8e58ef9 admin admin] Resource Subnet deleted: 6f0acb91-496c-45f4-acb5-584ff234a755 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:18.181398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-03d81ee3-27a6-4de4-b999-7328a8e58ef9 admin admin] Publish callbacks [] for Subnet (6f0acb91-496c-45f4-acb5-584ff234a755), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:18.390791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a3e3d4c7-302d-4f0f-b6c0-14e994ff9bae","delete","tap81a4888a-a0",6,["map",[["attached-mac","fa:16:3e:b6:cd:c7"],["iface-id","81a4888a-a035-4442-91ea-dd123a7c1c39"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:18.666815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:18Z,description='Default security group',id=b7fd8feb-af6c-4061-9ef8-a5b8e63530ba,is_default=True,name='default',project_id='dd3ba2bbb9b84133883b9595099787b1',revision_number=1,rules=[SecurityGroupRule(525f6be8-18d5-4ee1-ad8a-d8bed73cdfc2),SecurityGroupRule(5a20a2c1-9364-41fc-af7a-ed7951e83605),SecurityGroupRule(62195c85-f7d8-4fdf-a153-ce7bcbaf41d8),SecurityGroupRule(819920d1-e11b-4d82-97e6-81d9d66d1972)],shared=False,stateful=True,updated_at=2022-10-23T00:57:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:18.667288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b7fd8feb-af6c-4061-9ef8-a5b8e63530ba), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:18.668096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:18Z,description=,direction='ingress',ethertype='IPv4',id=525f6be8-18d5-4ee1-ad8a-d8bed73cdfc2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd3ba2bbb9b84133883b9595099787b1',protocol=,remote_address_group_id=,remote_group_id=b7fd8feb-af6c-4061-9ef8-a5b8e63530ba,remote_ip_prefix=,revision_number=0,security_group_id=b7fd8feb-af6c-4061-9ef8-a5b8e63530ba,updated_at=2022-10-23T00:57:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:18.668582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (525f6be8-18d5-4ee1-ad8a-d8bed73cdfc2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:18.669088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:18.669886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:18Z,description=,direction='egress',ethertype='IPv6',id=5a20a2c1-9364-41fc-af7a-ed7951e83605,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd3ba2bbb9b84133883b9595099787b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b7fd8feb-af6c-4061-9ef8-a5b8e63530ba,updated_at=2022-10-23T00:57:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:18.670370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5a20a2c1-9364-41fc-af7a-ed7951e83605), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:18.670960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:18.671683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:18Z,description=,direction='egress',ethertype='IPv4',id=62195c85-f7d8-4fdf-a153-ce7bcbaf41d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd3ba2bbb9b84133883b9595099787b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b7fd8feb-af6c-4061-9ef8-a5b8e63530ba,updated_at=2022-10-23T00:57:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:18.673078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (62195c85-f7d8-4fdf-a153-ce7bcbaf41d8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:18.674265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:18.675980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:18Z,description=,direction='ingress',ethertype='IPv6',id=819920d1-e11b-4d82-97e6-81d9d66d1972,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd3ba2bbb9b84133883b9595099787b1',protocol=,remote_address_group_id=,remote_group_id=b7fd8feb-af6c-4061-9ef8-a5b8e63530ba,remote_ip_prefix=,revision_number=0,security_group_id=b7fd8feb-af6c-4061-9ef8-a5b8e63530ba,updated_at=2022-10-23T00:57:18Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:18.678039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (819920d1-e11b-4d82-97e6-81d9d66d1972), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:18.678709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2fc8d07a-5477-457f-acff-2bc76a73cccc admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:18.784069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba942745-f52e-4742-9148-68bb8eb364b4 admin admin] Resource Port deleted: 81a4888a-a035-4442-91ea-dd123a7c1c39 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:18.784661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba942745-f52e-4742-9148-68bb8eb364b4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (81a4888a-a035-4442-91ea-dd123a7c1c39), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:18.829342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0304b3ea-6737-429f-b149-f8fcc5c59cdd None None] Resource Port deleted: 81a4888a-a035-4442-91ea-dd123a7c1c39 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:18.830588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0304b3ea-6737-429f-b149-f8fcc5c59cdd None None] Skipped duplicate delete event for 81a4888a-a035-4442-91ea-dd123a7c1c39 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 00:57:19.217181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Resource SecurityGroup deleted: b7fd8feb-af6c-4061-9ef8-a5b8e63530ba {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:19.217572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b7fd8feb-af6c-4061-9ef8-a5b8e63530ba), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:19.218072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b7fd8feb-af6c-4061-9ef8-a5b8e63530ba',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:19.235047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b7fd8feb-af6c-4061-9ef8-a5b8e63530ba',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:19.235631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Resource SecurityGroupRule deleted: 525f6be8-18d5-4ee1-ad8a-d8bed73cdfc2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:19.235896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (525f6be8-18d5-4ee1-ad8a-d8bed73cdfc2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:19.236227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:19.236616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Resource SecurityGroupRule deleted: 5a20a2c1-9364-41fc-af7a-ed7951e83605 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:19.236981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5a20a2c1-9364-41fc-af7a-ed7951e83605), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:19.237289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:19.237815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Resource SecurityGroupRule deleted: 62195c85-f7d8-4fdf-a153-ce7bcbaf41d8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:19.238292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (62195c85-f7d8-4fdf-a153-ce7bcbaf41d8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:19.238766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:19.239268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Resource SecurityGroupRule deleted: 819920d1-e11b-4d82-97e6-81d9d66d1972 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:19.239743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (819920d1-e11b-4d82-97e6-81d9d66d1972), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:19.240193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4c0d8b93-2e32-462f-9b81-6b588157063c admin admin] Security group rule updated ['b7fd8feb-af6c-4061-9ef8-a5b8e63530ba'] Oct 23 00:57:19.484260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba942745-f52e-4742-9148-68bb8eb364b4 admin admin] Resource Network deleted: af018619-0331-4553-bdbc-b12c91da85cf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:19.484885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba942745-f52e-4742-9148-68bb8eb364b4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (af018619-0331-4553-bdbc-b12c91da85cf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:19.887564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:292 started Oct 23 00:57:19.890329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=961000000,duration_sec=600,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:19.890928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:19.891383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:292 - starting polling. Elapsed:0.004 Oct 23 00:57:19.897325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:19.904288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b02,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:19.906125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b04,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:19.906707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:292 - port information retrieved. Elapsed:0.020 Oct 23 00:57:19.907221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': {'81a4888a-a035-4442-91ea-dd123a7c1c39', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:19.908485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:292 - agent port security group processed in 0.000 Oct 23 00:57:19.911499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 00:57:19.911959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'81a4888a-a035-4442-91ea-dd123a7c1c39', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3'} Oct 23 00:57:19.912542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port cfbaf355-dc65-4e70-a31f-49dfe300f3d3 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 00:57:19.913098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:19.976289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[404228fd-0e67-4a1a-9ace-b2dbdd0649c2]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:19.977374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'81a4888a-a035-4442-91ea-dd123a7c1c39', 'cfbaf355-dc65-4e70-a31f-49dfe300f3d3'} removed Oct 23 00:57:20.032661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 00:57:20.033187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 4 from net-id = af018619-0331-4553-bdbc-b12c91da85cf, seg-id = 354 Oct 23 00:57:20.038809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x13211939,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:20.048279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2b06,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4450}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:20.049193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 00:57:20.049926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:292 - treat_devices_removed completed in 0.138 Oct 23 00:57:20.050536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:292 - ports processed. Elapsed:0.163 Oct 23 00:57:20.052010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:292 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.164 Oct 23 00:57:20.166500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Resource SecurityGroup deleted: f3ce37d9-177c-4e87-927f-4bd88426ffae {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.167351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (f3ce37d9-177c-4e87-927f-4bd88426ffae), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.167863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f3ce37d9-177c-4e87-927f-4bd88426ffae',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:20.188320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f3ce37d9-177c-4e87-927f-4bd88426ffae',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:20.189141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Resource SecurityGroupRule deleted: 3580a2f6-b38b-4890-a3a0-6dc945389bda {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.190024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3580a2f6-b38b-4890-a3a0-6dc945389bda), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.190625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:57:20.191211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Resource SecurityGroupRule deleted: 4acd02be-9ec9-4fa7-8127-b5809a87d4b2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.191757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4acd02be-9ec9-4fa7-8127-b5809a87d4b2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.192287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:57:20.193438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Resource SecurityGroupRule deleted: 5ebd49f9-f60e-4864-9f91-57a214bbfb8f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.194008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5ebd49f9-f60e-4864-9f91-57a214bbfb8f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.194533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:57:20.195743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Resource SecurityGroupRule deleted: b9ee24e6-e00d-4116-baed-f0ecbaa9eb43 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.196284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b9ee24e6-e00d-4116-baed-f0ecbaa9eb43), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.197552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-990109cf-b9c7-4093-8d98-e659932d8076 admin admin] Security group rule updated ['f3ce37d9-177c-4e87-927f-4bd88426ffae'] Oct 23 00:57:20.273028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:20Z,description='Default security group',id=5b73c49f-744b-4711-a123-e5198dd17097,is_default=True,name='default',project_id='edfa3eef22c04f6393ac401dd7b9833d',revision_number=1,rules=[SecurityGroupRule(13244e3f-8a07-4733-a638-ae994e6185f7),SecurityGroupRule(51470f58-9dbf-422e-adc5-0d66185571a9),SecurityGroupRule(92b6cd08-1e27-45a4-8e6f-8c5231105f23),SecurityGroupRule(b4df66c5-fc67-4048-bb61-24546fcf0f7a)],shared=False,stateful=True,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:20.274365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (5b73c49f-744b-4711-a123-e5198dd17097), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.276261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='egress',ethertype='IPv4',id=13244e3f-8a07-4733-a638-ae994e6185f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='edfa3eef22c04f6393ac401dd7b9833d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5b73c49f-744b-4711-a123-e5198dd17097,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:20.276918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (13244e3f-8a07-4733-a638-ae994e6185f7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.277574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:20.279435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='ingress',ethertype='IPv4',id=51470f58-9dbf-422e-adc5-0d66185571a9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='edfa3eef22c04f6393ac401dd7b9833d',protocol=,remote_address_group_id=,remote_group_id=5b73c49f-744b-4711-a123-e5198dd17097,remote_ip_prefix=,revision_number=0,security_group_id=5b73c49f-744b-4711-a123-e5198dd17097,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:20.279878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (51470f58-9dbf-422e-adc5-0d66185571a9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.280822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:20.282948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='egress',ethertype='IPv6',id=92b6cd08-1e27-45a4-8e6f-8c5231105f23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='edfa3eef22c04f6393ac401dd7b9833d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5b73c49f-744b-4711-a123-e5198dd17097,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:20.283680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (92b6cd08-1e27-45a4-8e6f-8c5231105f23), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.284220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:20.286757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='ingress',ethertype='IPv6',id=b4df66c5-fc67-4048-bb61-24546fcf0f7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='edfa3eef22c04f6393ac401dd7b9833d',protocol=,remote_address_group_id=,remote_group_id=5b73c49f-744b-4711-a123-e5198dd17097,remote_ip_prefix=,revision_number=0,security_group_id=5b73c49f-744b-4711-a123-e5198dd17097,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:20.289956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b4df66c5-fc67-4048-bb61-24546fcf0f7a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.290526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-16f462ca-b7bf-4d36-894d-d5ec0f3b3d33 admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:20.430697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Resource SecurityGroup deleted: 5b73c49f-744b-4711-a123-e5198dd17097 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.430964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (5b73c49f-744b-4711-a123-e5198dd17097), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.431414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5b73c49f-744b-4711-a123-e5198dd17097',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:20.446497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5b73c49f-744b-4711-a123-e5198dd17097',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:20.447084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Resource SecurityGroupRule deleted: 13244e3f-8a07-4733-a638-ae994e6185f7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.447542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (13244e3f-8a07-4733-a638-ae994e6185f7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.448037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:20.448520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Resource SecurityGroupRule deleted: 51470f58-9dbf-422e-adc5-0d66185571a9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.449027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (51470f58-9dbf-422e-adc5-0d66185571a9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.449447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:20.449921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Resource SecurityGroupRule deleted: 92b6cd08-1e27-45a4-8e6f-8c5231105f23 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.450623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (92b6cd08-1e27-45a4-8e6f-8c5231105f23), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.451504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:20.452221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Resource SecurityGroupRule deleted: b4df66c5-fc67-4048-bb61-24546fcf0f7a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:20.453542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b4df66c5-fc67-4048-bb61-24546fcf0f7a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:20.454101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a757bc4-d961-4ff5-b9aa-461949d030ad admin admin] Security group rule updated ['5b73c49f-744b-4711-a123-e5198dd17097'] Oct 23 00:57:21.046654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:20Z,description='Default security group',id=6f10f2e3-bb8b-4a53-a957-3d5678b7de3b,is_default=True,name='default',project_id='68c2382849194f05a64a7ebbd993a086',revision_number=1,rules=[SecurityGroupRule(63160bf0-8729-47bf-81b7-48330b7bae57),SecurityGroupRule(7bfa32af-db65-4d71-91bf-15e78d2083da),SecurityGroupRule(a2d17fbf-6b72-4380-b49a-ed8b06161321),SecurityGroupRule(af385897-65d6-4316-a182-20aa04107bf2)],shared=False,stateful=True,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:21.047336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (6f10f2e3-bb8b-4a53-a957-3d5678b7de3b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.048141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='ingress',ethertype='IPv4',id=63160bf0-8729-47bf-81b7-48330b7bae57,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68c2382849194f05a64a7ebbd993a086',protocol=,remote_address_group_id=,remote_group_id=6f10f2e3-bb8b-4a53-a957-3d5678b7de3b,remote_ip_prefix=,revision_number=0,security_group_id=6f10f2e3-bb8b-4a53-a957-3d5678b7de3b,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:21.048509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (63160bf0-8729-47bf-81b7-48330b7bae57), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.048881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.050029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='egress',ethertype='IPv4',id=7bfa32af-db65-4d71-91bf-15e78d2083da,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68c2382849194f05a64a7ebbd993a086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f10f2e3-bb8b-4a53-a957-3d5678b7de3b,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:21.050399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7bfa32af-db65-4d71-91bf-15e78d2083da), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.050732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.051493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='egress',ethertype='IPv6',id=a2d17fbf-6b72-4380-b49a-ed8b06161321,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68c2382849194f05a64a7ebbd993a086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6f10f2e3-bb8b-4a53-a957-3d5678b7de3b,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:21.052562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a2d17fbf-6b72-4380-b49a-ed8b06161321), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.054019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.054726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:20Z,description=,direction='ingress',ethertype='IPv6',id=af385897-65d6-4316-a182-20aa04107bf2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68c2382849194f05a64a7ebbd993a086',protocol=,remote_address_group_id=,remote_group_id=6f10f2e3-bb8b-4a53-a957-3d5678b7de3b,remote_ip_prefix=,revision_number=0,security_group_id=6f10f2e3-bb8b-4a53-a957-3d5678b7de3b,updated_at=2022-10-23T00:57:20Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:21.057500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (af385897-65d6-4316-a182-20aa04107bf2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.058028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1f0cc820-21a3-4875-95c3-076c731048ad admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.185119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Resource SecurityGroup deleted: 6f10f2e3-bb8b-4a53-a957-3d5678b7de3b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:21.185503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (6f10f2e3-bb8b-4a53-a957-3d5678b7de3b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.185958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6f10f2e3-bb8b-4a53-a957-3d5678b7de3b',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:21.201623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6f10f2e3-bb8b-4a53-a957-3d5678b7de3b',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:21.202591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Resource SecurityGroupRule deleted: 63160bf0-8729-47bf-81b7-48330b7bae57 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:21.202981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (63160bf0-8729-47bf-81b7-48330b7bae57), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.203369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.203931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Resource SecurityGroupRule deleted: 7bfa32af-db65-4d71-91bf-15e78d2083da {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:21.204769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7bfa32af-db65-4d71-91bf-15e78d2083da), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.205245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.205844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Resource SecurityGroupRule deleted: a2d17fbf-6b72-4380-b49a-ed8b06161321 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:21.206514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a2d17fbf-6b72-4380-b49a-ed8b06161321), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.207279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.207919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Resource SecurityGroupRule deleted: af385897-65d6-4316-a182-20aa04107bf2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:21.208528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (af385897-65d6-4316-a182-20aa04107bf2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:21.209068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a78363fa-14a4-4af8-9d12-7f5a4d769b46 admin admin] Security group rule updated ['6f10f2e3-bb8b-4a53-a957-3d5678b7de3b'] Oct 23 00:57:21.889157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:293 started Oct 23 00:57:21.893223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=963000000,duration_sec=602,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:21.893997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:21.894549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:293 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:57:22.984532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:22Z,description='Default security group',id=2f463ff4-5c16-4a89-b97a-9c1f49c88f72,is_default=True,name='default',project_id='0a36f64fb91444b3a01512462a1716e4',revision_number=1,rules=[SecurityGroupRule(4c2dcefe-51d2-46cd-aaea-fe61892d7414),SecurityGroupRule(4cb5f30c-6172-47ed-987a-b6e52a612def),SecurityGroupRule(8a3e61ab-8ef6-4e25-9c0b-de57c02d0d25),SecurityGroupRule(aa299c53-ecfe-4739-94ca-b7575bb3d691)],shared=False,stateful=True,updated_at=2022-10-23T00:57:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:22.985217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (2f463ff4-5c16-4a89-b97a-9c1f49c88f72), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:22.985547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:22Z,description=,direction='egress',ethertype='IPv6',id=4c2dcefe-51d2-46cd-aaea-fe61892d7414,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a36f64fb91444b3a01512462a1716e4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2f463ff4-5c16-4a89-b97a-9c1f49c88f72,updated_at=2022-10-23T00:57:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:22.985900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4c2dcefe-51d2-46cd-aaea-fe61892d7414), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:22.986229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:22.986892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:22Z,description=,direction='ingress',ethertype='IPv4',id=4cb5f30c-6172-47ed-987a-b6e52a612def,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a36f64fb91444b3a01512462a1716e4',protocol=,remote_address_group_id=,remote_group_id=2f463ff4-5c16-4a89-b97a-9c1f49c88f72,remote_ip_prefix=,revision_number=0,security_group_id=2f463ff4-5c16-4a89-b97a-9c1f49c88f72,updated_at=2022-10-23T00:57:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:22.987238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4cb5f30c-6172-47ed-987a-b6e52a612def), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:22.987554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:22.988202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:22Z,description=,direction='ingress',ethertype='IPv6',id=8a3e61ab-8ef6-4e25-9c0b-de57c02d0d25,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a36f64fb91444b3a01512462a1716e4',protocol=,remote_address_group_id=,remote_group_id=2f463ff4-5c16-4a89-b97a-9c1f49c88f72,remote_ip_prefix=,revision_number=0,security_group_id=2f463ff4-5c16-4a89-b97a-9c1f49c88f72,updated_at=2022-10-23T00:57:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:22.988543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8a3e61ab-8ef6-4e25-9c0b-de57c02d0d25), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:22.988882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:22.989518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:22Z,description=,direction='egress',ethertype='IPv4',id=aa299c53-ecfe-4739-94ca-b7575bb3d691,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a36f64fb91444b3a01512462a1716e4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2f463ff4-5c16-4a89-b97a-9c1f49c88f72,updated_at=2022-10-23T00:57:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:22.989860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (aa299c53-ecfe-4739-94ca-b7575bb3d691), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:22.990175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a0f8092-86e5-45ef-b9b0-d33b4ea944ea admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:23.191517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Resource SecurityGroup deleted: 2f463ff4-5c16-4a89-b97a-9c1f49c88f72 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:23.192075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (2f463ff4-5c16-4a89-b97a-9c1f49c88f72), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:23.192938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2f463ff4-5c16-4a89-b97a-9c1f49c88f72',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:23.206896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2f463ff4-5c16-4a89-b97a-9c1f49c88f72',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:23.207398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Resource SecurityGroupRule deleted: 4c2dcefe-51d2-46cd-aaea-fe61892d7414 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:23.207794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4c2dcefe-51d2-46cd-aaea-fe61892d7414), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:23.208056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:23.208448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Resource SecurityGroupRule deleted: 4cb5f30c-6172-47ed-987a-b6e52a612def {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:23.208826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4cb5f30c-6172-47ed-987a-b6e52a612def), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:23.209146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:23.209516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Resource SecurityGroupRule deleted: 8a3e61ab-8ef6-4e25-9c0b-de57c02d0d25 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:23.209853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8a3e61ab-8ef6-4e25-9c0b-de57c02d0d25), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:23.210166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:23.210532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Resource SecurityGroupRule deleted: aa299c53-ecfe-4739-94ca-b7575bb3d691 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:23.210898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (aa299c53-ecfe-4739-94ca-b7575bb3d691), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:23.211239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3ef3e748-06fe-45d6-9b38-636c5dd04bc0 admin admin] Security group rule updated ['2f463ff4-5c16-4a89-b97a-9c1f49c88f72'] Oct 23 00:57:23.890552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:294 started Oct 23 00:57:23.893653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=964000000,duration_sec=604,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:23.894236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:23.894591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:294 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:24.687488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:24Z,description='Default security group',id=0133b4bb-6845-4e5f-8fe3-276120135dd8,is_default=True,name='default',project_id='d91fc2f28f7543d3a2e55274d0e87e77',revision_number=1,rules=[SecurityGroupRule(254d480b-5628-4153-8e91-9c80120e3527),SecurityGroupRule(543068a6-db7d-45cb-b016-0b8d96d0c0fc),SecurityGroupRule(55db43ed-27a5-4fde-8aac-9bf6b0a70795),SecurityGroupRule(e2966b12-2e83-479e-b57d-993ff8afc421)],shared=False,stateful=True,updated_at=2022-10-23T00:57:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:24.688528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (0133b4bb-6845-4e5f-8fe3-276120135dd8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.695569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:24Z,description=,direction='ingress',ethertype='IPv6',id=254d480b-5628-4153-8e91-9c80120e3527,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d91fc2f28f7543d3a2e55274d0e87e77',protocol=,remote_address_group_id=,remote_group_id=0133b4bb-6845-4e5f-8fe3-276120135dd8,remote_ip_prefix=,revision_number=0,security_group_id=0133b4bb-6845-4e5f-8fe3-276120135dd8,updated_at=2022-10-23T00:57:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:24.695569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (254d480b-5628-4153-8e91-9c80120e3527), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.695569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:24.695962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:24Z,description=,direction='egress',ethertype='IPv4',id=543068a6-db7d-45cb-b016-0b8d96d0c0fc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d91fc2f28f7543d3a2e55274d0e87e77',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0133b4bb-6845-4e5f-8fe3-276120135dd8,updated_at=2022-10-23T00:57:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:24.695962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (543068a6-db7d-45cb-b016-0b8d96d0c0fc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.695962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:24.696185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:24Z,description=,direction='egress',ethertype='IPv6',id=55db43ed-27a5-4fde-8aac-9bf6b0a70795,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d91fc2f28f7543d3a2e55274d0e87e77',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0133b4bb-6845-4e5f-8fe3-276120135dd8,updated_at=2022-10-23T00:57:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:24.696185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (55db43ed-27a5-4fde-8aac-9bf6b0a70795), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.696185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:24.696437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:24Z,description=,direction='ingress',ethertype='IPv4',id=e2966b12-2e83-479e-b57d-993ff8afc421,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d91fc2f28f7543d3a2e55274d0e87e77',protocol=,remote_address_group_id=,remote_group_id=0133b4bb-6845-4e5f-8fe3-276120135dd8,remote_ip_prefix=,revision_number=0,security_group_id=0133b4bb-6845-4e5f-8fe3-276120135dd8,updated_at=2022-10-23T00:57:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:24.696437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e2966b12-2e83-479e-b57d-993ff8afc421), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.696437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-397292e2-0e3b-4b5f-b0c8-e20e39bc356c admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:24.836141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Resource SecurityGroup deleted: 0133b4bb-6845-4e5f-8fe3-276120135dd8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:24.836636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (0133b4bb-6845-4e5f-8fe3-276120135dd8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.837227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0133b4bb-6845-4e5f-8fe3-276120135dd8',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:24.850237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0133b4bb-6845-4e5f-8fe3-276120135dd8',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:24.850850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Resource SecurityGroupRule deleted: 254d480b-5628-4153-8e91-9c80120e3527 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:24.851343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (254d480b-5628-4153-8e91-9c80120e3527), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.851701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:24.852089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Resource SecurityGroupRule deleted: 543068a6-db7d-45cb-b016-0b8d96d0c0fc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:24.852432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (543068a6-db7d-45cb-b016-0b8d96d0c0fc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.852778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:24.853147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Resource SecurityGroupRule deleted: 55db43ed-27a5-4fde-8aac-9bf6b0a70795 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:24.853486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (55db43ed-27a5-4fde-8aac-9bf6b0a70795), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.853800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:24.854164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Resource SecurityGroupRule deleted: e2966b12-2e83-479e-b57d-993ff8afc421 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:24.854502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e2966b12-2e83-479e-b57d-993ff8afc421), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:24.854816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3bf12cde-3120-40c6-ab19-f0dca9de9b28 admin admin] Security group rule updated ['0133b4bb-6845-4e5f-8fe3-276120135dd8'] Oct 23 00:57:25.891298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:295 started Oct 23 00:57:25.893775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=965000000,duration_sec=606,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:25.894419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:25.894748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:295 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:26.379787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:26Z,description='Default security group',id=7572d80b-5099-4dd5-b204-e40d77a906de,is_default=True,name='default',project_id='36e1cc0c3275464ca7e8a25917e54d1e',revision_number=1,rules=[SecurityGroupRule(0e6a2b0c-ef84-4e76-9a2d-950d000197d2),SecurityGroupRule(8ec38941-b8c9-4871-9fcc-8f43fb96a9d4),SecurityGroupRule(96df945d-70ae-43fa-99e9-31b756d3c368),SecurityGroupRule(f9b019d2-975a-40b8-88f8-4ebe74bcb63f)],shared=False,stateful=True,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.380269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (7572d80b-5099-4dd5-b204-e40d77a906de), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.381173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='ingress',ethertype='IPv4',id=0e6a2b0c-ef84-4e76-9a2d-950d000197d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36e1cc0c3275464ca7e8a25917e54d1e',protocol=,remote_address_group_id=,remote_group_id=7572d80b-5099-4dd5-b204-e40d77a906de,remote_ip_prefix=,revision_number=0,security_group_id=7572d80b-5099-4dd5-b204-e40d77a906de,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.381485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0e6a2b0c-ef84-4e76-9a2d-950d000197d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.381874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.382661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='egress',ethertype='IPv6',id=8ec38941-b8c9-4871-9fcc-8f43fb96a9d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36e1cc0c3275464ca7e8a25917e54d1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7572d80b-5099-4dd5-b204-e40d77a906de,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.383033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8ec38941-b8c9-4871-9fcc-8f43fb96a9d4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.383365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.384006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='egress',ethertype='IPv4',id=96df945d-70ae-43fa-99e9-31b756d3c368,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36e1cc0c3275464ca7e8a25917e54d1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7572d80b-5099-4dd5-b204-e40d77a906de,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.384348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (96df945d-70ae-43fa-99e9-31b756d3c368), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.384692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.385707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='ingress',ethertype='IPv6',id=f9b019d2-975a-40b8-88f8-4ebe74bcb63f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36e1cc0c3275464ca7e8a25917e54d1e',protocol=,remote_address_group_id=,remote_group_id=7572d80b-5099-4dd5-b204-e40d77a906de,remote_ip_prefix=,revision_number=0,security_group_id=7572d80b-5099-4dd5-b204-e40d77a906de,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.386051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f9b019d2-975a-40b8-88f8-4ebe74bcb63f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.386368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9015600d-f22b-4cb7-b73e-c9ea20011b96 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.529109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Resource SecurityGroup deleted: 7572d80b-5099-4dd5-b204-e40d77a906de {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:26.529609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (7572d80b-5099-4dd5-b204-e40d77a906de), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.530096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7572d80b-5099-4dd5-b204-e40d77a906de',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:26.544037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7572d80b-5099-4dd5-b204-e40d77a906de',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:26.544241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Resource SecurityGroupRule deleted: 0e6a2b0c-ef84-4e76-9a2d-950d000197d2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:26.544749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0e6a2b0c-ef84-4e76-9a2d-950d000197d2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.545094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.545488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Resource SecurityGroupRule deleted: 8ec38941-b8c9-4871-9fcc-8f43fb96a9d4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:26.545832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8ec38941-b8c9-4871-9fcc-8f43fb96a9d4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.546176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.546568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Resource SecurityGroupRule deleted: 96df945d-70ae-43fa-99e9-31b756d3c368 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:26.547024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (96df945d-70ae-43fa-99e9-31b756d3c368), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.547341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.547708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Resource SecurityGroupRule deleted: f9b019d2-975a-40b8-88f8-4ebe74bcb63f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:26.548048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f9b019d2-975a-40b8-88f8-4ebe74bcb63f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.548343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-660cf0f8-ad21-44f5-ad2a-18736bfcdde6 admin admin] Security group rule updated ['7572d80b-5099-4dd5-b204-e40d77a906de'] Oct 23 00:57:26.992589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:26Z,description='Default security group',id=38520521-af2b-4586-af44-e6ce0e5b84ca,is_default=True,name='default',project_id='fb8dd4ca62d1488295e017482d3393e5',revision_number=1,rules=[SecurityGroupRule(6da23dd1-0707-40e0-96c7-3fc3d2de55d8),SecurityGroupRule(6f2a4353-f1ef-41b1-b9a5-54e403e249e5),SecurityGroupRule(753b1767-6563-4658-9e16-6b9773720729),SecurityGroupRule(d9eec0b0-0340-449d-b93b-e611bb720a5c)],shared=False,stateful=True,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.993671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (38520521-af2b-4586-af44-e6ce0e5b84ca), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.994311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='ingress',ethertype='IPv4',id=6da23dd1-0707-40e0-96c7-3fc3d2de55d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb8dd4ca62d1488295e017482d3393e5',protocol=,remote_address_group_id=,remote_group_id=38520521-af2b-4586-af44-e6ce0e5b84ca,remote_ip_prefix=,revision_number=0,security_group_id=38520521-af2b-4586-af44-e6ce0e5b84ca,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.994673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6da23dd1-0707-40e0-96c7-3fc3d2de55d8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.995558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:26.996301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='egress',ethertype='IPv6',id=6f2a4353-f1ef-41b1-b9a5-54e403e249e5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb8dd4ca62d1488295e017482d3393e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38520521-af2b-4586-af44-e6ce0e5b84ca,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.996844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6f2a4353-f1ef-41b1-b9a5-54e403e249e5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:26.997356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:26.998050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='ingress',ethertype='IPv6',id=753b1767-6563-4658-9e16-6b9773720729,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb8dd4ca62d1488295e017482d3393e5',protocol=,remote_address_group_id=,remote_group_id=38520521-af2b-4586-af44-e6ce0e5b84ca,remote_ip_prefix=,revision_number=0,security_group_id=38520521-af2b-4586-af44-e6ce0e5b84ca,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:26.998409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (753b1767-6563-4658-9e16-6b9773720729), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.001211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:27.001926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:26Z,description=,direction='egress',ethertype='IPv4',id=d9eec0b0-0340-449d-b93b-e611bb720a5c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb8dd4ca62d1488295e017482d3393e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38520521-af2b-4586-af44-e6ce0e5b84ca,updated_at=2022-10-23T00:57:26Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:27.002285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d9eec0b0-0340-449d-b93b-e611bb720a5c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.002609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eb49f033-a6dd-43c3-b926-448bef5ad7ed admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:27.158869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Resource SecurityGroup deleted: 38520521-af2b-4586-af44-e6ce0e5b84ca {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:27.159451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (38520521-af2b-4586-af44-e6ce0e5b84ca), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.159898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('38520521-af2b-4586-af44-e6ce0e5b84ca',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:27.178361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('38520521-af2b-4586-af44-e6ce0e5b84ca',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:27.178966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Resource SecurityGroupRule deleted: 6da23dd1-0707-40e0-96c7-3fc3d2de55d8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:27.179512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6da23dd1-0707-40e0-96c7-3fc3d2de55d8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.179911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:27.180415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Resource SecurityGroupRule deleted: 6f2a4353-f1ef-41b1-b9a5-54e403e249e5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:27.181143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6f2a4353-f1ef-41b1-b9a5-54e403e249e5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.181577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:27.182201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Resource SecurityGroupRule deleted: 753b1767-6563-4658-9e16-6b9773720729 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:27.182898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (753b1767-6563-4658-9e16-6b9773720729), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.183857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:27.184508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Resource SecurityGroupRule deleted: d9eec0b0-0340-449d-b93b-e611bb720a5c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:27.185072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d9eec0b0-0340-449d-b93b-e611bb720a5c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.186157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-22484df3-8288-437c-ba6e-779e42319f53 admin admin] Security group rule updated ['38520521-af2b-4586-af44-e6ce0e5b84ca'] Oct 23 00:57:27.758507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-43f09d34-c678-460f-852a-39098b018f78 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:27Z,data_plane_status=None,description='',device_id='4d1f2d2c-cf59-418c-8ae7-70b0d032e5a6',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=29611acb-94f0-4480-8d4d-aaf6303b062c,mac_address=fa:16:3e:9c:4e:f2,name='',network_id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,numa_affinity_policy=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(29611acb-94f0-4480-8d4d-aaf6303b062c),security_group_ids=set([9e47da15-b648-4e05-8264-514053b0be27]),status='DOWN',updated_at=2022-10-23T00:57:27Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:27.758891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-43f09d34-c678-460f-852a-39098b018f78 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29611acb-94f0-4480-8d4d-aaf6303b062c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.759341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-43f09d34-c678-460f-852a-39098b018f78 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group member updated {'9e47da15-b648-4e05-8264-514053b0be27'} Oct 23 00:57:27.891972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:296 started Oct 23 00:57:27.896500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=967000000,duration_sec=608,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:27.897156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:27.897497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:296 - starting polling. Elapsed:0.006 Oct 23 00:57:27.900132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:27.903847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:296 - port information retrieved. Elapsed:0.012 Oct 23 00:57:27.905262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:296 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:57:28.493975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08762019-7600-49aa-86f4-e4477e1b8325 service neutron] Resource Port 29611acb-94f0-4480-8d4d-aaf6303b062c updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=29611acb-94f0-4480-8d4d-aaf6303b062c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=29611acb-94f0-4480-8d4d-aaf6303b062c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:28.495249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08762019-7600-49aa-86f4-e4477e1b8325 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29611acb-94f0-4480-8d4d-aaf6303b062c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.788206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-08762019-7600-49aa-86f4-e4477e1b8325 service neutron] Resource Port 29611acb-94f0-4480-8d4d-aaf6303b062c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=29611acb-94f0-4480-8d4d-aaf6303b062c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=29611acb-94f0-4480-8d4d-aaf6303b062c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=29611acb-94f0-4480-8d4d-aaf6303b062c,segment=NetworkSegment(d3b56b04-e2e1-4f00-a9db-1de40f8c425f),segment_id=d3b56b04-e2e1-4f00-a9db-1de40f8c425f)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:28.788685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-08762019-7600-49aa-86f4-e4477e1b8325 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29611acb-94f0-4480-8d4d-aaf6303b062c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.793206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:28Z,description='Default security group',id=e8fe811f-2481-4fab-b4e6-a59dc9b72a01,is_default=True,name='default',project_id='3b31bcc88e784bc881193ab513b8fef3',revision_number=1,rules=[SecurityGroupRule(2b2f2ebf-33b1-4eb5-8ecb-7180664bb71c),SecurityGroupRule(4e923f05-c2cd-4787-9e88-3159352b60db),SecurityGroupRule(4f1dfab0-74d3-4c91-802f-d4e051fe56c7),SecurityGroupRule(f507bd68-8867-4cfa-a89a-c1c103438baf)],shared=False,stateful=True,updated_at=2022-10-23T00:57:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:28.793569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (e8fe811f-2481-4fab-b4e6-a59dc9b72a01), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.794205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:28Z,description=,direction='ingress',ethertype='IPv6',id=2b2f2ebf-33b1-4eb5-8ecb-7180664bb71c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b31bcc88e784bc881193ab513b8fef3',protocol=,remote_address_group_id=,remote_group_id=e8fe811f-2481-4fab-b4e6-a59dc9b72a01,remote_ip_prefix=,revision_number=0,security_group_id=e8fe811f-2481-4fab-b4e6-a59dc9b72a01,updated_at=2022-10-23T00:57:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:28.794559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2b2f2ebf-33b1-4eb5-8ecb-7180664bb71c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.794888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:28.795554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:28Z,description=,direction='ingress',ethertype='IPv4',id=4e923f05-c2cd-4787-9e88-3159352b60db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b31bcc88e784bc881193ab513b8fef3',protocol=,remote_address_group_id=,remote_group_id=e8fe811f-2481-4fab-b4e6-a59dc9b72a01,remote_ip_prefix=,revision_number=0,security_group_id=e8fe811f-2481-4fab-b4e6-a59dc9b72a01,updated_at=2022-10-23T00:57:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:28.795895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4e923f05-c2cd-4787-9e88-3159352b60db), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.796213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:28.796882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:28Z,description=,direction='egress',ethertype='IPv6',id=4f1dfab0-74d3-4c91-802f-d4e051fe56c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b31bcc88e784bc881193ab513b8fef3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8fe811f-2481-4fab-b4e6-a59dc9b72a01,updated_at=2022-10-23T00:57:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:28.797271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4f1dfab0-74d3-4c91-802f-d4e051fe56c7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.807163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:28.808398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:28Z,description=,direction='egress',ethertype='IPv4',id=f507bd68-8867-4cfa-a89a-c1c103438baf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b31bcc88e784bc881193ab513b8fef3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8fe811f-2481-4fab-b4e6-a59dc9b72a01,updated_at=2022-10-23T00:57:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:28.808956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f507bd68-8867-4cfa-a89a-c1c103438baf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.809297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9d6820e7-7622-4c63-82ad-4e0b2de30bd7 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:28.946345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Resource SecurityGroup deleted: e8fe811f-2481-4fab-b4e6-a59dc9b72a01 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:28.946951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (e8fe811f-2481-4fab-b4e6-a59dc9b72a01), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.947595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e8fe811f-2481-4fab-b4e6-a59dc9b72a01',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:28.963421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e8fe811f-2481-4fab-b4e6-a59dc9b72a01',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:28.964036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Resource SecurityGroupRule deleted: 2b2f2ebf-33b1-4eb5-8ecb-7180664bb71c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:28.964284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2b2f2ebf-33b1-4eb5-8ecb-7180664bb71c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.964618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:28.965357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Resource SecurityGroupRule deleted: 4e923f05-c2cd-4787-9e88-3159352b60db {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:28.965758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4e923f05-c2cd-4787-9e88-3159352b60db), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.966242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:28.966639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Resource SecurityGroupRule deleted: 4f1dfab0-74d3-4c91-802f-d4e051fe56c7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:28.966981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4f1dfab0-74d3-4c91-802f-d4e051fe56c7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.967299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:28.967677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Resource SecurityGroupRule deleted: f507bd68-8867-4cfa-a89a-c1c103438baf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:28.968020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f507bd68-8867-4cfa-a89a-c1c103438baf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:28.968335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6d7dc377-5fc5-4566-9c1c-c93a68d69116 admin admin] Security group rule updated ['e8fe811f-2481-4fab-b4e6-a59dc9b72a01'] Oct 23 00:57:29.486211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:29Z,description='Default security group',id=63a36655-c8e3-447a-9ade-5a5aabc090f6,is_default=True,name='default',project_id='e57fdef796914c2ab7f7da935ba6d3ad',revision_number=1,rules=[SecurityGroupRule(1c8d5f02-a113-4e8d-96fd-1d949cfa1a47),SecurityGroupRule(4f9cc77c-ccd2-43fa-8bb8-26ca8f75bf81),SecurityGroupRule(b1fad9e3-36ae-4c90-92c4-787fe65de55b),SecurityGroupRule(ff43be17-c55b-4401-b1d2-871b4be11df5)],shared=False,stateful=True,updated_at=2022-10-23T00:57:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:29.486708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (63a36655-c8e3-447a-9ade-5a5aabc090f6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.487312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:29Z,description=,direction='egress',ethertype='IPv4',id=1c8d5f02-a113-4e8d-96fd-1d949cfa1a47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e57fdef796914c2ab7f7da935ba6d3ad',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=63a36655-c8e3-447a-9ade-5a5aabc090f6,updated_at=2022-10-23T00:57:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:29.487667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1c8d5f02-a113-4e8d-96fd-1d949cfa1a47), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.487997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.488760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:29Z,description=,direction='egress',ethertype='IPv6',id=4f9cc77c-ccd2-43fa-8bb8-26ca8f75bf81,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e57fdef796914c2ab7f7da935ba6d3ad',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=63a36655-c8e3-447a-9ade-5a5aabc090f6,updated_at=2022-10-23T00:57:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:29.489632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4f9cc77c-ccd2-43fa-8bb8-26ca8f75bf81), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.489947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.490742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:29Z,description=,direction='ingress',ethertype='IPv4',id=b1fad9e3-36ae-4c90-92c4-787fe65de55b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e57fdef796914c2ab7f7da935ba6d3ad',protocol=,remote_address_group_id=,remote_group_id=63a36655-c8e3-447a-9ade-5a5aabc090f6,remote_ip_prefix=,revision_number=0,security_group_id=63a36655-c8e3-447a-9ade-5a5aabc090f6,updated_at=2022-10-23T00:57:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:29.491230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b1fad9e3-36ae-4c90-92c4-787fe65de55b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.491704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.492494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:29Z,description=,direction='ingress',ethertype='IPv6',id=ff43be17-c55b-4401-b1d2-871b4be11df5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e57fdef796914c2ab7f7da935ba6d3ad',protocol=,remote_address_group_id=,remote_group_id=63a36655-c8e3-447a-9ade-5a5aabc090f6,remote_ip_prefix=,revision_number=0,security_group_id=63a36655-c8e3-447a-9ade-5a5aabc090f6,updated_at=2022-10-23T00:57:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:29.493011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ff43be17-c55b-4401-b1d2-871b4be11df5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.493468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33e4a15c-8561-48d4-aec0-629f3f48731b admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.639845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Resource SecurityGroup deleted: 63a36655-c8e3-447a-9ade-5a5aabc090f6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:29.641362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (63a36655-c8e3-447a-9ade-5a5aabc090f6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.642022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('63a36655-c8e3-447a-9ade-5a5aabc090f6',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:29.655452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('63a36655-c8e3-447a-9ade-5a5aabc090f6',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:29.655938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Resource SecurityGroupRule deleted: 1c8d5f02-a113-4e8d-96fd-1d949cfa1a47 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:29.656282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1c8d5f02-a113-4e8d-96fd-1d949cfa1a47), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.656812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.657235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Resource SecurityGroupRule deleted: 4f9cc77c-ccd2-43fa-8bb8-26ca8f75bf81 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:29.657584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4f9cc77c-ccd2-43fa-8bb8-26ca8f75bf81), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.657915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.658286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Resource SecurityGroupRule deleted: b1fad9e3-36ae-4c90-92c4-787fe65de55b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:29.658606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b1fad9e3-36ae-4c90-92c4-787fe65de55b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.659044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.659408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Resource SecurityGroupRule deleted: ff43be17-c55b-4401-b1d2-871b4be11df5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:29.659887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ff43be17-c55b-4401-b1d2-871b4be11df5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.660349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ef85c44d-6463-4970-a047-9e302cc044a1 admin admin] Security group rule updated ['63a36655-c8e3-447a-9ade-5a5aabc090f6'] Oct 23 00:57:29.894268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:297 started Oct 23 00:57:29.896879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=968000000,duration_sec=610,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:29.897495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:29.898167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:297 - starting polling. Elapsed:0.004 Oct 23 00:57:29.900994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:29.904623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:297 - port information retrieved. Elapsed:0.011 Oct 23 00:57:29.905130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:297 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 00:57:30.170399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:30Z,description='Default security group',id=206620a8-f7f7-4d4d-9b98-9472c30b32df,is_default=True,name='default',project_id='1a580a03968c46c29e146de07486265f',revision_number=1,rules=[SecurityGroupRule(36bf4a67-8fcf-424b-abab-9214ab82a124),SecurityGroupRule(702fc68f-faa7-468e-8bec-ceb51ff06c80),SecurityGroupRule(848cdb58-bcc9-4aed-adfd-e327e6bfaeb6),SecurityGroupRule(ebf09829-779d-46fd-a095-9be0023fd1bf)],shared=False,stateful=True,updated_at=2022-10-23T00:57:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:30.170970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (206620a8-f7f7-4d4d-9b98-9472c30b32df), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.172613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:30Z,description=,direction='ingress',ethertype='IPv4',id=36bf4a67-8fcf-424b-abab-9214ab82a124,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a580a03968c46c29e146de07486265f',protocol=,remote_address_group_id=,remote_group_id=206620a8-f7f7-4d4d-9b98-9472c30b32df,remote_ip_prefix=,revision_number=0,security_group_id=206620a8-f7f7-4d4d-9b98-9472c30b32df,updated_at=2022-10-23T00:57:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:30.172992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (36bf4a67-8fcf-424b-abab-9214ab82a124), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.173342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:30.174150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:30Z,description=,direction='egress',ethertype='IPv6',id=702fc68f-faa7-468e-8bec-ceb51ff06c80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a580a03968c46c29e146de07486265f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=206620a8-f7f7-4d4d-9b98-9472c30b32df,updated_at=2022-10-23T00:57:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:30.174522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (702fc68f-faa7-468e-8bec-ceb51ff06c80), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.175004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:30.175669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:30Z,description=,direction='ingress',ethertype='IPv6',id=848cdb58-bcc9-4aed-adfd-e327e6bfaeb6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a580a03968c46c29e146de07486265f',protocol=,remote_address_group_id=,remote_group_id=206620a8-f7f7-4d4d-9b98-9472c30b32df,remote_ip_prefix=,revision_number=0,security_group_id=206620a8-f7f7-4d4d-9b98-9472c30b32df,updated_at=2022-10-23T00:57:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:30.176019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (848cdb58-bcc9-4aed-adfd-e327e6bfaeb6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.176344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:30.177027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:30Z,description=,direction='egress',ethertype='IPv4',id=ebf09829-779d-46fd-a095-9be0023fd1bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a580a03968c46c29e146de07486265f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=206620a8-f7f7-4d4d-9b98-9472c30b32df,updated_at=2022-10-23T00:57:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:30.177576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ebf09829-779d-46fd-a095-9be0023fd1bf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.178151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b04f6690-9b69-4b22-b02f-84b901c51d74 admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:30.313836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Resource SecurityGroup deleted: 206620a8-f7f7-4d4d-9b98-9472c30b32df {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:30.314398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (206620a8-f7f7-4d4d-9b98-9472c30b32df), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.314863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('206620a8-f7f7-4d4d-9b98-9472c30b32df',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:30.338114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('206620a8-f7f7-4d4d-9b98-9472c30b32df',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:30.338594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Resource SecurityGroupRule deleted: 36bf4a67-8fcf-424b-abab-9214ab82a124 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:30.339671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (36bf4a67-8fcf-424b-abab-9214ab82a124), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.340100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:30.340669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Resource SecurityGroupRule deleted: 702fc68f-faa7-468e-8bec-ceb51ff06c80 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:30.341145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (702fc68f-faa7-468e-8bec-ceb51ff06c80), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.341453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:30.342058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Resource SecurityGroupRule deleted: 848cdb58-bcc9-4aed-adfd-e327e6bfaeb6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:30.342592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (848cdb58-bcc9-4aed-adfd-e327e6bfaeb6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.343053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:30.343412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Resource SecurityGroupRule deleted: ebf09829-779d-46fd-a095-9be0023fd1bf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:30.343756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ebf09829-779d-46fd-a095-9be0023fd1bf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:30.344099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-434d5ea9-b3e7-4645-901e-0a4104b42aed admin admin] Security group rule updated ['206620a8-f7f7-4d4d-9b98-9472c30b32df'] Oct 23 00:57:31.895861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:298 started Oct 23 00:57:31.900350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=971000000,duration_sec=612,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:31.901532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:31.902740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:298 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:57:33.055529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:32Z,description='Default security group',id=668d1024-d605-4cbc-921b-675c208a5860,is_default=True,name='default',project_id='dd580427de994a2e86dd966416ec7dc1',revision_number=1,rules=[SecurityGroupRule(0d006652-901c-424f-aaaf-66c3e1856e26),SecurityGroupRule(186ca4f8-8d4f-4ef0-a0be-cb45800ed570),SecurityGroupRule(7c471534-b61c-48b7-a8e9-14a85ba089d6),SecurityGroupRule(c41565d3-7b7a-4ea2-a370-9f7e7b108023)],shared=False,stateful=True,updated_at=2022-10-23T00:57:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.056140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (668d1024-d605-4cbc-921b-675c208a5860), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.056710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:32Z,description=,direction='ingress',ethertype='IPv4',id=0d006652-901c-424f-aaaf-66c3e1856e26,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd580427de994a2e86dd966416ec7dc1',protocol=,remote_address_group_id=,remote_group_id=668d1024-d605-4cbc-921b-675c208a5860,remote_ip_prefix=,revision_number=0,security_group_id=668d1024-d605-4cbc-921b-675c208a5860,updated_at=2022-10-23T00:57:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.057166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0d006652-901c-424f-aaaf-66c3e1856e26), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.057608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.058475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:32Z,description=,direction='ingress',ethertype='IPv6',id=186ca4f8-8d4f-4ef0-a0be-cb45800ed570,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd580427de994a2e86dd966416ec7dc1',protocol=,remote_address_group_id=,remote_group_id=668d1024-d605-4cbc-921b-675c208a5860,remote_ip_prefix=,revision_number=0,security_group_id=668d1024-d605-4cbc-921b-675c208a5860,updated_at=2022-10-23T00:57:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.059157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (186ca4f8-8d4f-4ef0-a0be-cb45800ed570), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.059850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.060585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:32Z,description=,direction='egress',ethertype='IPv6',id=7c471534-b61c-48b7-a8e9-14a85ba089d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd580427de994a2e86dd966416ec7dc1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=668d1024-d605-4cbc-921b-675c208a5860,updated_at=2022-10-23T00:57:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.060999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7c471534-b61c-48b7-a8e9-14a85ba089d6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.061386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.062085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:32Z,description=,direction='egress',ethertype='IPv4',id=c41565d3-7b7a-4ea2-a370-9f7e7b108023,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dd580427de994a2e86dd966416ec7dc1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=668d1024-d605-4cbc-921b-675c208a5860,updated_at=2022-10-23T00:57:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.062491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c41565d3-7b7a-4ea2-a370-9f7e7b108023), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.062986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3612f06f-ef8d-45d4-9e86-60f072894e29 admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.302252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Resource SecurityGroup deleted: 668d1024-d605-4cbc-921b-675c208a5860 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.302651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (668d1024-d605-4cbc-921b-675c208a5860), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.303093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('668d1024-d605-4cbc-921b-675c208a5860',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:33.322136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('668d1024-d605-4cbc-921b-675c208a5860',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:33.322688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Resource SecurityGroupRule deleted: 0d006652-901c-424f-aaaf-66c3e1856e26 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.323166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0d006652-901c-424f-aaaf-66c3e1856e26), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.323552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.323997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Resource SecurityGroupRule deleted: 186ca4f8-8d4f-4ef0-a0be-cb45800ed570 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.324418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (186ca4f8-8d4f-4ef0-a0be-cb45800ed570), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.324848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.325268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Resource SecurityGroupRule deleted: 7c471534-b61c-48b7-a8e9-14a85ba089d6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.325657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7c471534-b61c-48b7-a8e9-14a85ba089d6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.326026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.326462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Resource SecurityGroupRule deleted: c41565d3-7b7a-4ea2-a370-9f7e7b108023 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.326848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c41565d3-7b7a-4ea2-a370-9f7e7b108023), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.327213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c357db0-c8e9-4e97-ac5e-e6ff7d0294ce admin admin] Security group rule updated ['668d1024-d605-4cbc-921b-675c208a5860'] Oct 23 00:57:33.763528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:33Z,description='Default security group',id=406428ac-700b-40ee-85aa-77fe60613700,is_default=True,name='default',project_id='d185d929007947fb8ad4ce755fb3ee9c',revision_number=1,rules=[SecurityGroupRule(1fdac081-4f26-40bc-880f-6357f050a83c),SecurityGroupRule(539ea996-e11b-4daf-959d-a0085b5d1da0),SecurityGroupRule(72dbc201-516b-4b54-8801-34ddc4f064ce),SecurityGroupRule(ff3379ed-a01c-4439-ae4b-6c205fa29ccf)],shared=False,stateful=True,updated_at=2022-10-23T00:57:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.764206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (406428ac-700b-40ee-85aa-77fe60613700), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.764929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:33Z,description=,direction='egress',ethertype='IPv6',id=1fdac081-4f26-40bc-880f-6357f050a83c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d185d929007947fb8ad4ce755fb3ee9c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=406428ac-700b-40ee-85aa-77fe60613700,updated_at=2022-10-23T00:57:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.765285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1fdac081-4f26-40bc-880f-6357f050a83c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.765614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:33.766560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:33Z,description=,direction='ingress',ethertype='IPv6',id=539ea996-e11b-4daf-959d-a0085b5d1da0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d185d929007947fb8ad4ce755fb3ee9c',protocol=,remote_address_group_id=,remote_group_id=406428ac-700b-40ee-85aa-77fe60613700,remote_ip_prefix=,revision_number=0,security_group_id=406428ac-700b-40ee-85aa-77fe60613700,updated_at=2022-10-23T00:57:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.766650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (539ea996-e11b-4daf-959d-a0085b5d1da0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.767073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:33.767802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:33Z,description=,direction='egress',ethertype='IPv4',id=72dbc201-516b-4b54-8801-34ddc4f064ce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d185d929007947fb8ad4ce755fb3ee9c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=406428ac-700b-40ee-85aa-77fe60613700,updated_at=2022-10-23T00:57:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.768311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (72dbc201-516b-4b54-8801-34ddc4f064ce), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.768894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:33.769531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:33Z,description=,direction='ingress',ethertype='IPv4',id=ff3379ed-a01c-4439-ae4b-6c205fa29ccf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d185d929007947fb8ad4ce755fb3ee9c',protocol=,remote_address_group_id=,remote_group_id=406428ac-700b-40ee-85aa-77fe60613700,remote_ip_prefix=,revision_number=0,security_group_id=406428ac-700b-40ee-85aa-77fe60613700,updated_at=2022-10-23T00:57:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:33.769914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ff3379ed-a01c-4439-ae4b-6c205fa29ccf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.770220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-866fce1a-2452-49a9-add4-dbb5116e861c admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:33.897504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:299 started Oct 23 00:57:33.900142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=971000000,duration_sec=614,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:33.900804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:33.901173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:299 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:33.933221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Resource SecurityGroup deleted: 406428ac-700b-40ee-85aa-77fe60613700 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.934247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (406428ac-700b-40ee-85aa-77fe60613700), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.935018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('406428ac-700b-40ee-85aa-77fe60613700',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:33.959129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('406428ac-700b-40ee-85aa-77fe60613700',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:33.959582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Resource SecurityGroupRule deleted: 1fdac081-4f26-40bc-880f-6357f050a83c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.959946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1fdac081-4f26-40bc-880f-6357f050a83c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.960389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:33.960650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Resource SecurityGroupRule deleted: 539ea996-e11b-4daf-959d-a0085b5d1da0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.961024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (539ea996-e11b-4daf-959d-a0085b5d1da0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.961336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:33.961701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Resource SecurityGroupRule deleted: 72dbc201-516b-4b54-8801-34ddc4f064ce {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.962034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (72dbc201-516b-4b54-8801-34ddc4f064ce), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.962342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:33.962702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Resource SecurityGroupRule deleted: ff3379ed-a01c-4439-ae4b-6c205fa29ccf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:33.963031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ff3379ed-a01c-4439-ae4b-6c205fa29ccf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:33.963336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ff4cb9b6-ab2a-4a06-9323-52cd9f45e47b admin admin] Security group rule updated ['406428ac-700b-40ee-85aa-77fe60613700'] Oct 23 00:57:35.898299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:300 started Oct 23 00:57:35.901375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=972000000,duration_sec=616,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:35.901942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:35.902288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:300 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:37.899284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:301 started Oct 23 00:57:37.901782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=973000000,duration_sec=618,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:37.902367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:37.902783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:301 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:39.900807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:302 started Oct 23 00:57:39.903456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=974000000,duration_sec=620,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:39.904171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:39.904547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:302 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:57:40.833587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:40Z,description='Default security group',id=e88c8627-8279-4c0c-8d95-a315f1910792,is_default=True,name='default',project_id='ed2d3af06d1c40e499eb0f287713b9eb',revision_number=1,rules=[SecurityGroupRule(5cad7aee-e6df-4a43-b143-7d71661e0da3),SecurityGroupRule(7fa17ac7-aebf-40bd-8e62-ada348c15ac1),SecurityGroupRule(99c3f8c6-24c1-40c6-b0c5-87623ed3b632),SecurityGroupRule(a48e2d8f-8dbf-4f3a-a57c-98377887e2d0)],shared=False,stateful=True,updated_at=2022-10-23T00:57:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:40.834260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (e88c8627-8279-4c0c-8d95-a315f1910792), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:40.835122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:40Z,description=,direction='ingress',ethertype='IPv4',id=5cad7aee-e6df-4a43-b143-7d71661e0da3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed2d3af06d1c40e499eb0f287713b9eb',protocol=,remote_address_group_id=,remote_group_id=e88c8627-8279-4c0c-8d95-a315f1910792,remote_ip_prefix=,revision_number=0,security_group_id=e88c8627-8279-4c0c-8d95-a315f1910792,updated_at=2022-10-23T00:57:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:40.836039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5cad7aee-e6df-4a43-b143-7d71661e0da3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:40.836573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:40.839202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:40Z,description=,direction='egress',ethertype='IPv4',id=7fa17ac7-aebf-40bd-8e62-ada348c15ac1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed2d3af06d1c40e499eb0f287713b9eb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e88c8627-8279-4c0c-8d95-a315f1910792,updated_at=2022-10-23T00:57:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:40.839775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7fa17ac7-aebf-40bd-8e62-ada348c15ac1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:40.840323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:40.841456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:40Z,description=,direction='ingress',ethertype='IPv6',id=99c3f8c6-24c1-40c6-b0c5-87623ed3b632,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed2d3af06d1c40e499eb0f287713b9eb',protocol=,remote_address_group_id=,remote_group_id=e88c8627-8279-4c0c-8d95-a315f1910792,remote_ip_prefix=,revision_number=0,security_group_id=e88c8627-8279-4c0c-8d95-a315f1910792,updated_at=2022-10-23T00:57:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:40.842034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (99c3f8c6-24c1-40c6-b0c5-87623ed3b632), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:40.844148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:40.845047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:40Z,description=,direction='egress',ethertype='IPv6',id=a48e2d8f-8dbf-4f3a-a57c-98377887e2d0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed2d3af06d1c40e499eb0f287713b9eb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e88c8627-8279-4c0c-8d95-a315f1910792,updated_at=2022-10-23T00:57:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:40.845593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a48e2d8f-8dbf-4f3a-a57c-98377887e2d0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:40.846279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-76e0ac53-0790-4a00-af5c-6ba122196c48 admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:40.995242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Resource SecurityGroup deleted: e88c8627-8279-4c0c-8d95-a315f1910792 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:40.995822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (e88c8627-8279-4c0c-8d95-a315f1910792), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:40.996346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e88c8627-8279-4c0c-8d95-a315f1910792',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:41.011311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e88c8627-8279-4c0c-8d95-a315f1910792',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:41.011989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Resource SecurityGroupRule deleted: 5cad7aee-e6df-4a43-b143-7d71661e0da3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:41.012366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5cad7aee-e6df-4a43-b143-7d71661e0da3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:41.012763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:41.013342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Resource SecurityGroupRule deleted: 7fa17ac7-aebf-40bd-8e62-ada348c15ac1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:41.013964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7fa17ac7-aebf-40bd-8e62-ada348c15ac1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:41.014804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:41.015260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Resource SecurityGroupRule deleted: 99c3f8c6-24c1-40c6-b0c5-87623ed3b632 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:41.015646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (99c3f8c6-24c1-40c6-b0c5-87623ed3b632), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:41.015998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:41.016388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Resource SecurityGroupRule deleted: a48e2d8f-8dbf-4f3a-a57c-98377887e2d0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:41.016912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a48e2d8f-8dbf-4f3a-a57c-98377887e2d0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:41.017256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7798a7b4-4933-4adb-aea4-6ac979bb0a2c admin admin] Security group rule updated ['e88c8627-8279-4c0c-8d95-a315f1910792'] Oct 23 00:57:41.604549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 29611acb-94f0-4480-8d4d-aaf6303b062c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:41.604981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29611acb-94f0-4480-8d4d-aaf6303b062c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:41.902321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:303 started Oct 23 00:57:41.905263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=976000000,duration_sec=622,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:41.905950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:41.906384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:303 - starting polling. Elapsed:0.005 Oct 23 00:57:41.909299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:41.914653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:303 - port information retrieved. Elapsed:0.013 Oct 23 00:57:41.916322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:303 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 23 00:57:42.181922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:41Z,description='Default security group',id=96dc7cd4-e33a-4511-863c-aec4e3978d3a,is_default=True,name='default',project_id='06d40f667d954ad98dcdfa16de95e393',revision_number=1,rules=[SecurityGroupRule(1e9ecc2e-975a-481c-a5ad-91d76dd03724),SecurityGroupRule(5ceb59c2-e082-4c0e-b0fd-4d175b2b710f),SecurityGroupRule(bae2e80c-4cf3-4a9e-a85f-1f77cb31d7f7),SecurityGroupRule(d54044a0-966b-41ea-a93d-fc0f020064a9)],shared=False,stateful=True,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.182513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (96dc7cd4-e33a-4511-863c-aec4e3978d3a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.182923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='egress',ethertype='IPv6',id=1e9ecc2e-975a-481c-a5ad-91d76dd03724,normalized_cidr=None,port_range_max=,port_range_min=,project_id='06d40f667d954ad98dcdfa16de95e393',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=96dc7cd4-e33a-4511-863c-aec4e3978d3a,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.183288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1e9ecc2e-975a-481c-a5ad-91d76dd03724), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.183629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.184380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='ingress',ethertype='IPv4',id=5ceb59c2-e082-4c0e-b0fd-4d175b2b710f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='06d40f667d954ad98dcdfa16de95e393',protocol=,remote_address_group_id=,remote_group_id=96dc7cd4-e33a-4511-863c-aec4e3978d3a,remote_ip_prefix=,revision_number=0,security_group_id=96dc7cd4-e33a-4511-863c-aec4e3978d3a,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.184803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5ceb59c2-e082-4c0e-b0fd-4d175b2b710f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.185326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.186345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='egress',ethertype='IPv4',id=bae2e80c-4cf3-4a9e-a85f-1f77cb31d7f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='06d40f667d954ad98dcdfa16de95e393',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=96dc7cd4-e33a-4511-863c-aec4e3978d3a,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.186710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (bae2e80c-4cf3-4a9e-a85f-1f77cb31d7f7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.187039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.188266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='ingress',ethertype='IPv6',id=d54044a0-966b-41ea-a93d-fc0f020064a9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='06d40f667d954ad98dcdfa16de95e393',protocol=,remote_address_group_id=,remote_group_id=96dc7cd4-e33a-4511-863c-aec4e3978d3a,remote_ip_prefix=,revision_number=0,security_group_id=96dc7cd4-e33a-4511-863c-aec4e3978d3a,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.188625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d54044a0-966b-41ea-a93d-fc0f020064a9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.189100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-32ea61a2-e177-452e-ba28-7d98dc4c60c9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.266902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:42Z,description='Default security group',id=ef20917c-8dad-4b49-8e2b-5fc4aa0568d5,is_default=True,name='default',project_id='2b5536e4b945479e8972cb5a95f60324',revision_number=1,rules=[SecurityGroupRule(430bf725-4787-4330-a6de-bcda8aeca4a8),SecurityGroupRule(61f0c4f2-73f6-4eef-ad3d-074ece03e348),SecurityGroupRule(a8d85478-02d6-443a-8bc8-124184205a5a),SecurityGroupRule(ae95f667-901f-4aea-a5f1-170838c8d0cc)],shared=False,stateful=True,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.267340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (ef20917c-8dad-4b49-8e2b-5fc4aa0568d5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.268000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='egress',ethertype='IPv4',id=430bf725-4787-4330-a6de-bcda8aeca4a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef20917c-8dad-4b49-8e2b-5fc4aa0568d5,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.268447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (430bf725-4787-4330-a6de-bcda8aeca4a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.268858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 00:57:42.269569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='ingress',ethertype='IPv6',id=61f0c4f2-73f6-4eef-ad3d-074ece03e348,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol=,remote_address_group_id=,remote_group_id=ef20917c-8dad-4b49-8e2b-5fc4aa0568d5,remote_ip_prefix=,revision_number=0,security_group_id=ef20917c-8dad-4b49-8e2b-5fc4aa0568d5,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.269902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (61f0c4f2-73f6-4eef-ad3d-074ece03e348), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.270389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 00:57:42.271138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='egress',ethertype='IPv6',id=a8d85478-02d6-443a-8bc8-124184205a5a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef20917c-8dad-4b49-8e2b-5fc4aa0568d5,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.271783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a8d85478-02d6-443a-8bc8-124184205a5a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.272161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 00:57:42.272839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:42Z,description=,direction='ingress',ethertype='IPv4',id=ae95f667-901f-4aea-a5f1-170838c8d0cc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol=,remote_address_group_id=,remote_group_id=ef20917c-8dad-4b49-8e2b-5fc4aa0568d5,remote_ip_prefix=,revision_number=0,security_group_id=ef20917c-8dad-4b49-8e2b-5fc4aa0568d5,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.273350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ae95f667-901f-4aea-a5f1-170838c8d0cc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.273834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 00:57:42.311018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Resource SecurityGroup deleted: 96dc7cd4-e33a-4511-863c-aec4e3978d3a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:42.311604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (96dc7cd4-e33a-4511-863c-aec4e3978d3a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.312366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('96dc7cd4-e33a-4511-863c-aec4e3978d3a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:42.350556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('96dc7cd4-e33a-4511-863c-aec4e3978d3a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:42.350556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Resource SecurityGroupRule deleted: 1e9ecc2e-975a-481c-a5ad-91d76dd03724 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:42.350556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1e9ecc2e-975a-481c-a5ad-91d76dd03724), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.350929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.351273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Resource SecurityGroupRule deleted: 5ceb59c2-e082-4c0e-b0fd-4d175b2b710f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:42.351948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5ceb59c2-e082-4c0e-b0fd-4d175b2b710f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.352064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.352379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Resource SecurityGroupRule deleted: bae2e80c-4cf3-4a9e-a85f-1f77cb31d7f7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:42.353205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (bae2e80c-4cf3-4a9e-a85f-1f77cb31d7f7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.353530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.353905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Resource SecurityGroupRule deleted: d54044a0-966b-41ea-a93d-fc0f020064a9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:42.354247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d54044a0-966b-41ea-a93d-fc0f020064a9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.354564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8571eb4a-ae74-4167-af56-128c2cb802f9 admin admin] Security group rule updated ['96dc7cd4-e33a-4511-863c-aec4e3978d3a'] Oct 23 00:57:42.476746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:57:42Z,description='',dns_domain=None,id=a82fecef-3e22-41fa-8192-25cadd682e03,mtu=1500,name='tempest-TestMinimumBasicScenario-1769746546-network',project_id='2b5536e4b945479e8972cb5a95f60324',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(a82fecef-3e22-41fa-8192-25cadd682e03),segments=[NetworkSegment(cddd1db6-cf69-4403-969b-c4a8db3f5024)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:57:42Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.477127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (a82fecef-3e22-41fa-8192-25cadd682e03), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-c543dde4-04c5-4d64-a7a5-18cde479ca28 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a82fecef-3e22-41fa-8192-25cadd682e03 with segmentation id not found. Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:57:42.585021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:57:42.586056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:57:42.586056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:57:42.586056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:57:42.586056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a82fecef-3e22-41fa-8192-25cadd682e03 with segmentation id not found. Oct 23 00:57:42.586056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:57:42.829550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b13e9703-b23d-413e-b35c-636b68f4e156 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(45d2dfe3-6d02-4554-a3cf-11684f9b2053)],cidr=172.20.0.0/28,created_at=2022-10-23T00:57:42Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=943dfaf8-c12c-409b-b313-a2e572eba44f,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-1769746546-subnet',network_id=a82fecef-3e22-41fa-8192-25cadd682e03,project_id='2b5536e4b945479e8972cb5a95f60324',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:57:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:42.829910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b13e9703-b23d-413e-b35c-636b68f4e156 admin admin] Publish callbacks [] for Subnet (943dfaf8-c12c-409b-b313-a2e572eba44f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.513751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:43Z,description='Default security group',id=edd961ec-398b-4462-bfd4-50d374d46246,is_default=True,name='default',project_id='d35d948e36884dd0a2c26450dc9763aa',revision_number=1,rules=[SecurityGroupRule(194cf3c0-450e-44d1-81b6-3058811e1679),SecurityGroupRule(8514dbf8-fcbf-48bb-83b0-fe81f0f31fea),SecurityGroupRule(85312998-f868-44f3-a6c4-03d4446de9dc),SecurityGroupRule(a8e26de3-15fc-45d2-86dd-5f556e4b5620)],shared=False,stateful=True,updated_at=2022-10-23T00:57:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:43.514906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (edd961ec-398b-4462-bfd4-50d374d46246), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.515806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:43Z,description=,direction='ingress',ethertype='IPv6',id=194cf3c0-450e-44d1-81b6-3058811e1679,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d35d948e36884dd0a2c26450dc9763aa',protocol=,remote_address_group_id=,remote_group_id=edd961ec-398b-4462-bfd4-50d374d46246,remote_ip_prefix=,revision_number=0,security_group_id=edd961ec-398b-4462-bfd4-50d374d46246,updated_at=2022-10-23T00:57:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:43.516413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (194cf3c0-450e-44d1-81b6-3058811e1679), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.516975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:43.517850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:43Z,description=,direction='egress',ethertype='IPv4',id=8514dbf8-fcbf-48bb-83b0-fe81f0f31fea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d35d948e36884dd0a2c26450dc9763aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=edd961ec-398b-4462-bfd4-50d374d46246,updated_at=2022-10-23T00:57:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:43.518411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8514dbf8-fcbf-48bb-83b0-fe81f0f31fea), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.518955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:43.519866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:43Z,description=,direction='ingress',ethertype='IPv4',id=85312998-f868-44f3-a6c4-03d4446de9dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d35d948e36884dd0a2c26450dc9763aa',protocol=,remote_address_group_id=,remote_group_id=edd961ec-398b-4462-bfd4-50d374d46246,remote_ip_prefix=,revision_number=0,security_group_id=edd961ec-398b-4462-bfd4-50d374d46246,updated_at=2022-10-23T00:57:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:43.520440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (85312998-f868-44f3-a6c4-03d4446de9dc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.520997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:43.521846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:43Z,description=,direction='egress',ethertype='IPv6',id=a8e26de3-15fc-45d2-86dd-5f556e4b5620,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d35d948e36884dd0a2c26450dc9763aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=edd961ec-398b-4462-bfd4-50d374d46246,updated_at=2022-10-23T00:57:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:43.522508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a8e26de3-15fc-45d2-86dd-5f556e4b5620), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.523046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1bf5157c-183f-40d8-ba21-324f769c27c9 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:43.531239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02ad9531-0a8b-49a6-a159-c479cda9247a None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:43Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a82fecef-3e22-41fa-8192-25cadd682e03',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=503e26a7-75c9-489f-b284-76bdedd789ba,mac_address=fa:16:3e:1e:6c:f3,name='',network_id=a82fecef-3e22-41fa-8192-25cadd682e03,numa_affinity_policy=,project_id='2b5536e4b945479e8972cb5a95f60324',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(503e26a7-75c9-489f-b284-76bdedd789ba),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:57:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:43.531972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02ad9531-0a8b-49a6-a159-c479cda9247a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (503e26a7-75c9-489f-b284-76bdedd789ba), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.898838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 29611acb-94f0-4480-8d4d-aaf6303b062c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:43.903968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29611acb-94f0-4480-8d4d-aaf6303b062c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.905446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:304 started Oct 23 00:57:43.911564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=979000000,duration_sec=624,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:43.913453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:43.915121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:304 - starting polling. Elapsed:0.010 Oct 23 00:57:43.922716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:43.935855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:304 - port information retrieved. Elapsed:0.029 Oct 23 00:57:43.937188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:304 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.031 Oct 23 00:57:44.012490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02ad9531-0a8b-49a6-a159-c479cda9247a None None] Resource Port 503e26a7-75c9-489f-b284-76bdedd789ba updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=503e26a7-75c9-489f-b284-76bdedd789ba,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=503e26a7-75c9-489f-b284-76bdedd789ba,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=503e26a7-75c9-489f-b284-76bdedd789ba,segment=NetworkSegment(cddd1db6-cf69-4403-969b-c4a8db3f5024),segment_id=cddd1db6-cf69-4403-969b-c4a8db3f5024)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:44.013436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02ad9531-0a8b-49a6-a159-c479cda9247a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (503e26a7-75c9-489f-b284-76bdedd789ba), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.020676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Resource SecurityGroup deleted: edd961ec-398b-4462-bfd4-50d374d46246 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:44.021249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (edd961ec-398b-4462-bfd4-50d374d46246), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.022402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('edd961ec-398b-4462-bfd4-50d374d46246',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:44.042835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('edd961ec-398b-4462-bfd4-50d374d46246',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:44.048037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Resource SecurityGroupRule deleted: 194cf3c0-450e-44d1-81b6-3058811e1679 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:44.049328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (194cf3c0-450e-44d1-81b6-3058811e1679), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.051264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:44.051920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Resource SecurityGroupRule deleted: 8514dbf8-fcbf-48bb-83b0-fe81f0f31fea {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:44.052814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8514dbf8-fcbf-48bb-83b0-fe81f0f31fea), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.055571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:44.058053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Resource SecurityGroupRule deleted: 85312998-f868-44f3-a6c4-03d4446de9dc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:44.058436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (85312998-f868-44f3-a6c4-03d4446de9dc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.058785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:44.061953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Resource SecurityGroupRule deleted: a8e26de3-15fc-45d2-86dd-5f556e4b5620 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:44.062535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a8e26de3-15fc-45d2-86dd-5f556e4b5620), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.063019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2f361fe-318d-4d49-b36c-dc7f6ad60769 admin admin] Security group rule updated ['edd961ec-398b-4462-bfd4-50d374d46246'] Oct 23 00:57:44.171065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cac4c048-b694-4b59-859f-d287faf27a48","insert","tap503e26a7-75",["set",[]],["map",[["attached-mac","fa:16:3e:1e:6c:f3"],["iface-id","503e26a7-75c9-489f-b284-76bdedd789ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:44.206689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cac4c048-b694-4b59-859f-d287faf27a48","old",null,["set",[]],null],["","new","tap503e26a7-75",24,["map",[["attached-mac","fa:16:3e:1e:6c:f3"],["iface-id","503e26a7-75c9-489f-b284-76bdedd789ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:44.221276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e25ffe99-7653-40cd-bd5b-9b14c5bbf761 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:43Z,data_plane_status=None,description='',device_id='ccc4a4a5-6896-45a8-ac65-8e16513ab31f',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ec2a1257-8a89-482a-b313-cba09c2f2203,mac_address=fa:16:3e:57:e0:52,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ec2a1257-8a89-482a-b313-cba09c2f2203),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:57:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:44.221662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e25ffe99-7653-40cd-bd5b-9b14c5bbf761 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ec2a1257-8a89-482a-b313-cba09c2f2203), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.826278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:44Z,description='Default security group',id=465d716d-783a-4ee8-a760-485d5b691f5e,is_default=True,name='default',project_id='fa1daec8b70343a2a8896b71cebfdce1',revision_number=1,rules=[SecurityGroupRule(87eca5cd-77da-4a7e-9cc1-202e4fdc2797),SecurityGroupRule(9f1dd2e7-f186-4837-ac21-0747c2990418),SecurityGroupRule(a3c756da-2e8e-4130-a709-b6900a248427),SecurityGroupRule(cd8768bd-8887-495f-aa49-dbe5d5eb4087)],shared=False,stateful=True,updated_at=2022-10-23T00:57:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:44.826912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (465d716d-783a-4ee8-a760-485d5b691f5e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.827303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:44Z,description=,direction='ingress',ethertype='IPv6',id=87eca5cd-77da-4a7e-9cc1-202e4fdc2797,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1daec8b70343a2a8896b71cebfdce1',protocol=,remote_address_group_id=,remote_group_id=465d716d-783a-4ee8-a760-485d5b691f5e,remote_ip_prefix=,revision_number=0,security_group_id=465d716d-783a-4ee8-a760-485d5b691f5e,updated_at=2022-10-23T00:57:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:44.827705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (87eca5cd-77da-4a7e-9cc1-202e4fdc2797), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.828052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:44.828766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:44Z,description=,direction='ingress',ethertype='IPv4',id=9f1dd2e7-f186-4837-ac21-0747c2990418,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1daec8b70343a2a8896b71cebfdce1',protocol=,remote_address_group_id=,remote_group_id=465d716d-783a-4ee8-a760-485d5b691f5e,remote_ip_prefix=,revision_number=0,security_group_id=465d716d-783a-4ee8-a760-485d5b691f5e,updated_at=2022-10-23T00:57:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:44.829118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9f1dd2e7-f186-4837-ac21-0747c2990418), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.829483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:44.830247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:44Z,description=,direction='egress',ethertype='IPv4',id=a3c756da-2e8e-4130-a709-b6900a248427,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1daec8b70343a2a8896b71cebfdce1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=465d716d-783a-4ee8-a760-485d5b691f5e,updated_at=2022-10-23T00:57:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:44.830767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a3c756da-2e8e-4130-a709-b6900a248427), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.831212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:44.833927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:44Z,description=,direction='egress',ethertype='IPv6',id=cd8768bd-8887-495f-aa49-dbe5d5eb4087,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1daec8b70343a2a8896b71cebfdce1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=465d716d-783a-4ee8-a760-485d5b691f5e,updated_at=2022-10-23T00:57:44Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:44.834446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (cd8768bd-8887-495f-aa49-dbe5d5eb4087), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:44.834934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3a461b91-890e-48b2-8efa-aa23c48d9e60 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:45.043274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Resource SecurityGroup deleted: 465d716d-783a-4ee8-a760-485d5b691f5e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:45.043651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (465d716d-783a-4ee8-a760-485d5b691f5e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:45.044141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('465d716d-783a-4ee8-a760-485d5b691f5e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:45.061741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('465d716d-783a-4ee8-a760-485d5b691f5e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:45.062238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Resource SecurityGroupRule deleted: 87eca5cd-77da-4a7e-9cc1-202e4fdc2797 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:45.063036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (87eca5cd-77da-4a7e-9cc1-202e4fdc2797), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:45.063505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:45.064252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Resource SecurityGroupRule deleted: 9f1dd2e7-f186-4837-ac21-0747c2990418 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:45.064769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9f1dd2e7-f186-4837-ac21-0747c2990418), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:45.065221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:45.065725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Resource SecurityGroupRule deleted: a3c756da-2e8e-4130-a709-b6900a248427 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:45.066196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a3c756da-2e8e-4130-a709-b6900a248427), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:45.066873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:45.067495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Resource SecurityGroupRule deleted: cd8768bd-8887-495f-aa49-dbe5d5eb4087 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:45.068548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (cd8768bd-8887-495f-aa49-dbe5d5eb4087), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:45.068912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bdce8db5-1c3b-4459-bdd3-65bbdd1f4550 admin admin] Security group rule updated ['465d716d-783a-4ee8-a760-485d5b691f5e'] Oct 23 00:57:45.907771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:305 started Oct 23 00:57:45.911169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=982000000,duration_sec=626,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:45.912491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:45.913473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:305 - starting polling. Elapsed:0.006 Oct 23 00:57:45.916315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:45.920693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:305 - port information retrieved. Elapsed:0.013 Oct 23 00:57:45.921253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'503e26a7-75c9-489f-b284-76bdedd789ba'}, 'removed': set(), 'updated': {'503e26a7-75c9-489f-b284-76bdedd789ba'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:45.921992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '503e26a7-75c9-489f-b284-76bdedd789ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a82fecef-3e22-41fa-8192-25cadd682e03', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '503e26a7-75c9-489f-b284-76bdedd789ba', 'mac_address': 'fa:16:3e:1e:6c:f3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:45.926850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 503e26a7-75c9-489f-b284-76bdedd789ba {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:45.927375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 503e26a7-75c9-489f-b284-76bdedd789ba updated. Details: {'device': '503e26a7-75c9-489f-b284-76bdedd789ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a82fecef-3e22-41fa-8192-25cadd682e03', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '503e26a7-75c9-489f-b284-76bdedd789ba', 'mac_address': 'fa:16:3e:1e:6c:f3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:57:45.928553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 10 as local vlan for net-id=a82fecef-3e22-41fa-8192-25cadd682e03, seg-id=390 Oct 23 00:57:45.933903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1321193b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4486), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:45.939701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2b22,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4106)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4486}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:45.941059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap503e26a7-75, col_values=(('tag', 10),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:45.942357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap503e26a7-75, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:45.943024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap503e26a7-75, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:45.954505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap503e26a7-75, col_values=(('other_config', {'net_uuid': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '390'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:45.973804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b24,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:45.974653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:305 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.052 Oct 23 00:57:45.977879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:57:45.978302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'503e26a7-75c9-489f-b284-76bdedd789ba'} Oct 23 00:57:45.984151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:45.984747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:46.009809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:46.086128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:45Z,description='Default security group',id=959a97e3-ae0f-4f6c-872c-0e1116d6578f,is_default=True,name='default',project_id='5a63258352d24a0d9706e0a419a9903a',revision_number=1,rules=[SecurityGroupRule(87e43525-d827-4553-b990-c13f7a20d708),SecurityGroupRule(b433e6a1-56d0-4512-9bcc-a883e4eaddae),SecurityGroupRule(b9fe1b0c-5ba3-4226-8b24-b5f5cb01b75c),SecurityGroupRule(f475a939-6e7b-403b-b2fb-5cdd13fe62b6)],shared=False,stateful=True,updated_at=2022-10-23T00:57:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:46.087332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (959a97e3-ae0f-4f6c-872c-0e1116d6578f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.089827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:45Z,description=,direction='ingress',ethertype='IPv6',id=87e43525-d827-4553-b990-c13f7a20d708,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a63258352d24a0d9706e0a419a9903a',protocol=,remote_address_group_id=,remote_group_id=959a97e3-ae0f-4f6c-872c-0e1116d6578f,remote_ip_prefix=,revision_number=0,security_group_id=959a97e3-ae0f-4f6c-872c-0e1116d6578f,updated_at=2022-10-23T00:57:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:46.092870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (87e43525-d827-4553-b990-c13f7a20d708), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.093490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.095377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[51851892-ea46-451e-9a59-dfbd553d9c67]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:46.096810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:305 - agent port security group processed in 0.175 Oct 23 00:57:46.097612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 503e26a7-75c9-489f-b284-76bdedd789ba to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:46.099611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:45Z,description=,direction='ingress',ethertype='IPv4',id=b433e6a1-56d0-4512-9bcc-a883e4eaddae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a63258352d24a0d9706e0a419a9903a',protocol=,remote_address_group_id=,remote_group_id=959a97e3-ae0f-4f6c-872c-0e1116d6578f,remote_ip_prefix=,revision_number=0,security_group_id=959a97e3-ae0f-4f6c-872c-0e1116d6578f,updated_at=2022-10-23T00:57:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:46.099977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b433e6a1-56d0-4512-9bcc-a883e4eaddae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.100301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.105373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:45Z,description=,direction='egress',ethertype='IPv6',id=b9fe1b0c-5ba3-4226-8b24-b5f5cb01b75c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a63258352d24a0d9706e0a419a9903a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=959a97e3-ae0f-4f6c-872c-0e1116d6578f,updated_at=2022-10-23T00:57:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:46.105759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b9fe1b0c-5ba3-4226-8b24-b5f5cb01b75c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.106086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.124335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:45Z,description=,direction='egress',ethertype='IPv4',id=f475a939-6e7b-403b-b2fb-5cdd13fe62b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a63258352d24a0d9706e0a419a9903a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=959a97e3-ae0f-4f6c-872c-0e1116d6578f,updated_at=2022-10-23T00:57:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:46.127338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f475a939-6e7b-403b-b2fb-5cdd13fe62b6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.129920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69f76396-9779-48d5-84c9-885906bf04d9 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.348117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Resource SecurityGroup deleted: 959a97e3-ae0f-4f6c-872c-0e1116d6578f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:46.348417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (959a97e3-ae0f-4f6c-872c-0e1116d6578f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.349073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('959a97e3-ae0f-4f6c-872c-0e1116d6578f',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:46.487301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('959a97e3-ae0f-4f6c-872c-0e1116d6578f',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:46.487866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Resource SecurityGroupRule deleted: 87e43525-d827-4553-b990-c13f7a20d708 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:46.488674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (87e43525-d827-4553-b990-c13f7a20d708), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.489269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.489897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Resource SecurityGroupRule deleted: b433e6a1-56d0-4512-9bcc-a883e4eaddae {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:46.490906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b433e6a1-56d0-4512-9bcc-a883e4eaddae), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.493037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.493584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Resource SecurityGroupRule deleted: b9fe1b0c-5ba3-4226-8b24-b5f5cb01b75c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:46.494480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b9fe1b0c-5ba3-4226-8b24-b5f5cb01b75c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.495640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.496403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Resource SecurityGroupRule deleted: f475a939-6e7b-403b-b2fb-5cdd13fe62b6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:46.497023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f475a939-6e7b-403b-b2fb-5cdd13fe62b6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.498081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-50ebebb4-9ae7-4bb4-8d85-81ec004a2c03 admin admin] Security group rule updated ['959a97e3-ae0f-4f6c-872c-0e1116d6578f'] Oct 23 00:57:46.581589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b1666fb0-a4b5-43c6-94b8-9402ea06b712 None None] Resource Port 503e26a7-75c9-489f-b284-76bdedd789ba updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:46.582016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b1666fb0-a4b5-43c6-94b8-9402ea06b712 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (503e26a7-75c9-489f-b284-76bdedd789ba), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.669522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cf54ce22-d065-4450-b9ab-c206c0480943 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:46Z,data_plane_status=None,description='',device_id='ccc4a4a5-6896-45a8-ac65-8e16513ab31f',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3f16f421-4b09-4db8-bb39-036024ad1e08,mac_address=fa:16:3e:c8:e9:92,name='',network_id=a82fecef-3e22-41fa-8192-25cadd682e03,numa_affinity_policy=,project_id='2b5536e4b945479e8972cb5a95f60324',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3f16f421-4b09-4db8-bb39-036024ad1e08),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:57:46Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:46.669899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cf54ce22-d065-4450-b9ab-c206c0480943 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3f16f421-4b09-4db8-bb39-036024ad1e08), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:46.720288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['503e26a7-75c9-489f-b284-76bdedd789ba'] and devices down [] completed. Oct 23 00:57:46.720606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:305 - ports processed. Elapsed:0.813 Oct 23 00:57:46.720962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:305 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.813 Oct 23 00:57:47.113894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fade1252-0109-4e21-9b8d-62ff551de4eb None None] Resource Port ec2a1257-8a89-482a-b313-cba09c2f2203 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ec2a1257-8a89-482a-b313-cba09c2f2203,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ec2a1257-8a89-482a-b313-cba09c2f2203,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:47.115010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fade1252-0109-4e21-9b8d-62ff551de4eb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ec2a1257-8a89-482a-b313-cba09c2f2203), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.354076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fade1252-0109-4e21-9b8d-62ff551de4eb None None] Resource Port ec2a1257-8a89-482a-b313-cba09c2f2203 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ec2a1257-8a89-482a-b313-cba09c2f2203,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ec2a1257-8a89-482a-b313-cba09c2f2203,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ec2a1257-8a89-482a-b313-cba09c2f2203,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:47.354460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fade1252-0109-4e21-9b8d-62ff551de4eb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ec2a1257-8a89-482a-b313-cba09c2f2203), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.474563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cf54ce22-d065-4450-b9ab-c206c0480943 admin admin] Received resource Port update without any changes: 3f16f421-4b09-4db8-bb39-036024ad1e08 {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:57:47.521234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:47Z,description='Default security group',id=27bf14d3-b2b8-4f67-ad70-134fbecf897c,is_default=True,name='default',project_id='22fe1df260454239b8e403c4723f9762',revision_number=1,rules=[SecurityGroupRule(1d15e434-3c38-4ba8-95cf-98f8471ed1a7),SecurityGroupRule(43a51be3-4863-47bc-983f-e75287e79df8),SecurityGroupRule(c85c2898-1880-47be-b4d5-8b2614868dc0),SecurityGroupRule(f3cbec65-b801-4fe1-93a9-69d841e963bc)],shared=False,stateful=True,updated_at=2022-10-23T00:57:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:47.521860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (27bf14d3-b2b8-4f67-ad70-134fbecf897c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.522650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:47Z,description=,direction='ingress',ethertype='IPv4',id=1d15e434-3c38-4ba8-95cf-98f8471ed1a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22fe1df260454239b8e403c4723f9762',protocol=,remote_address_group_id=,remote_group_id=27bf14d3-b2b8-4f67-ad70-134fbecf897c,remote_ip_prefix=,revision_number=0,security_group_id=27bf14d3-b2b8-4f67-ad70-134fbecf897c,updated_at=2022-10-23T00:57:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:47.523154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1d15e434-3c38-4ba8-95cf-98f8471ed1a7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.523841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.524671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:47Z,description=,direction='egress',ethertype='IPv4',id=43a51be3-4863-47bc-983f-e75287e79df8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22fe1df260454239b8e403c4723f9762',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=27bf14d3-b2b8-4f67-ad70-134fbecf897c,updated_at=2022-10-23T00:57:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:47.525052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (43a51be3-4863-47bc-983f-e75287e79df8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.525397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.527847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:47Z,description=,direction='egress',ethertype='IPv6',id=c85c2898-1880-47be-b4d5-8b2614868dc0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22fe1df260454239b8e403c4723f9762',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=27bf14d3-b2b8-4f67-ad70-134fbecf897c,updated_at=2022-10-23T00:57:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:47.527847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c85c2898-1880-47be-b4d5-8b2614868dc0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.527847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.528185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:47Z,description=,direction='ingress',ethertype='IPv6',id=f3cbec65-b801-4fe1-93a9-69d841e963bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22fe1df260454239b8e403c4723f9762',protocol=,remote_address_group_id=,remote_group_id=27bf14d3-b2b8-4f67-ad70-134fbecf897c,remote_ip_prefix=,revision_number=0,security_group_id=27bf14d3-b2b8-4f67-ad70-134fbecf897c,updated_at=2022-10-23T00:57:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:47.534893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f3cbec65-b801-4fe1-93a9-69d841e963bc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.535231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-21794c6b-97b6-4931-97a4-44334fbb5336 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.868712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Resource SecurityGroup deleted: 27bf14d3-b2b8-4f67-ad70-134fbecf897c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:47.869119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (27bf14d3-b2b8-4f67-ad70-134fbecf897c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.869781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('27bf14d3-b2b8-4f67-ad70-134fbecf897c',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:57:47.908197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:306 started Oct 23 00:57:47.911310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=982000000,duration_sec=628,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:47.911939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:47.912276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:306 - starting polling. Elapsed:0.004 Oct 23 00:57:47.916393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.924134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:306 - port information retrieved. Elapsed:0.016 Oct 23 00:57:47.924473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'503e26a7-75c9-489f-b284-76bdedd789ba'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:47.925090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '503e26a7-75c9-489f-b284-76bdedd789ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a82fecef-3e22-41fa-8192-25cadd682e03', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '503e26a7-75c9-489f-b284-76bdedd789ba', 'mac_address': 'fa:16:3e:1e:6c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:47.928616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 503e26a7-75c9-489f-b284-76bdedd789ba {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:47.945191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 503e26a7-75c9-489f-b284-76bdedd789ba updated. Details: {'device': '503e26a7-75c9-489f-b284-76bdedd789ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a82fecef-3e22-41fa-8192-25cadd682e03', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '503e26a7-75c9-489f-b284-76bdedd789ba', 'mac_address': 'fa:16:3e:1e:6c:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 23 00:57:47.947256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap503e26a7-75, col_values=(('tag', 10),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:47.957201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap503e26a7-75, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:47.957850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap503e26a7-75, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:47.960139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:47.962797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('27bf14d3-b2b8-4f67-ad70-134fbecf897c',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:57:47.965292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Resource SecurityGroupRule deleted: 1d15e434-3c38-4ba8-95cf-98f8471ed1a7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:47.966036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1d15e434-3c38-4ba8-95cf-98f8471ed1a7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.974041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.974719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Resource SecurityGroupRule deleted: 43a51be3-4863-47bc-983f-e75287e79df8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:47.983420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (43a51be3-4863-47bc-983f-e75287e79df8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.983420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.983420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Resource SecurityGroupRule deleted: c85c2898-1880-47be-b4d5-8b2614868dc0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:47.983420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c85c2898-1880-47be-b4d5-8b2614868dc0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.983420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.986860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Resource SecurityGroupRule deleted: f3cbec65-b801-4fe1-93a9-69d841e963bc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:57:47.986860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f3cbec65-b801-4fe1-93a9-69d841e963bc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:47.989088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0e0be461-c15f-42d1-a75b-385b9d15fc29 admin admin] Security group rule updated ['27bf14d3-b2b8-4f67-ad70-134fbecf897c'] Oct 23 00:57:47.991805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap503e26a7-75, col_values=(('other_config', {'net_uuid': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '390', 'tag': '10'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:47.993366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:48.002851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b28,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:48.003390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:306 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.078 Oct 23 00:57:48.004777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:57:48.005658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:57:48.007064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:48.007480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:48.013801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:48.091944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52c43ad-0c43-4976-ba58-41e535796101]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:48.092981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:306 - agent port security group processed in 0.168 Oct 23 00:57:48.094570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 503e26a7-75c9-489f-b284-76bdedd789ba to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:48.209345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["afd3f2f8-c1fc-46a5-956f-b97d2bde069d","insert","qr-3f16f421-4b",["set",[]],["map",[["attached-mac","fa:16:3e:c8:e9:92"],["iface-id","3f16f421-4b09-4db8-bb39-036024ad1e08"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:48.231808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["afd3f2f8-c1fc-46a5-956f-b97d2bde069d","old",null,["set",[]],null],["","new","qr-3f16f421-4b",25,["map",[["attached-mac","fa:16:3e:c8:e9:92"],["iface-id","3f16f421-4b09-4db8-bb39-036024ad1e08"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:48.595649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['503e26a7-75c9-489f-b284-76bdedd789ba'] and devices down [] completed. Oct 23 00:57:48.595965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:306 - ports processed. Elapsed:0.688 Oct 23 00:57:48.596459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:306 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.688 Oct 23 00:57:48.840739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6f83f2b9-5d2a-4705-93f6-2bcefeb51e0f","insert","qg-ec2a1257-8a",["set",[]],["map",[["attached-mac","fa:16:3e:57:e0:52"],["iface-id","ec2a1257-8a89-482a-b313-cba09c2f2203"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:48.854910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6f83f2b9-5d2a-4705-93f6-2bcefeb51e0f","old",null,["set",[]],null],["","new","qg-ec2a1257-8a",26,["map",[["attached-mac","fa:16:3e:57:e0:52"],["iface-id","ec2a1257-8a89-482a-b313-cba09c2f2203"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:49.013123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:48Z,description='tempest-description--1185854461',id=2024e950-6bc4-4c6f-8358-200660ce4c9f,is_default=False,name='tempest-securitygroup--925670627',project_id='94cfcbd6f144492d8be27fe35cbe76d5',revision_number=1,rules=[SecurityGroupRule(3c4f9444-961d-4f9d-86d9-dbd400f59bb5),SecurityGroupRule(c8bf6a6d-7c6e-45af-b8a5-f6abc8a41e79)],shared=False,stateful=True,updated_at=2022-10-23T00:57:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.015270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (2024e950-6bc4-4c6f-8358-200660ce4c9f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.016108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:48Z,description=,direction='egress',ethertype='IPv6',id=3c4f9444-961d-4f9d-86d9-dbd400f59bb5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2024e950-6bc4-4c6f-8358-200660ce4c9f,updated_at=2022-10-23T00:57:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.017929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3c4f9444-961d-4f9d-86d9-dbd400f59bb5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.019009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 00:57:49.019880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:48Z,description=,direction='egress',ethertype='IPv4',id=c8bf6a6d-7c6e-45af-b8a5-f6abc8a41e79,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2024e950-6bc4-4c6f-8358-200660ce4c9f,updated_at=2022-10-23T00:57:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.020426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c8bf6a6d-7c6e-45af-b8a5-f6abc8a41e79), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.020948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1cc46e73-76b8-49cd-acd0-7b14115ddb71 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 00:57:49.109992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3295dd47-4ed8-4e83-be53-ae82ce6dc1fc tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:49Z,description='',direction='ingress',ethertype='IPv4',id=7d37275f-910d-463a-8697-c8f931d757a8,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2024e950-6bc4-4c6f-8358-200660ce4c9f,updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.110764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3295dd47-4ed8-4e83-be53-ae82ce6dc1fc tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7d37275f-910d-463a-8697-c8f931d757a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.111206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3295dd47-4ed8-4e83-be53-ae82ce6dc1fc tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 00:57:49.493368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a23bd74a-25ff-4ed4-84a5-5e6e414a0d77 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:49Z,description='',direction='ingress',ethertype='IPv4',id=743deb65-d71b-4dc6-8f3d-24409be6e439,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2024e950-6bc4-4c6f-8358-200660ce4c9f,updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.494020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a23bd74a-25ff-4ed4-84a5-5e6e414a0d77 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (743deb65-d71b-4dc6-8f3d-24409be6e439), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.494354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a23bd74a-25ff-4ed4-84a5-5e6e414a0d77 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 00:57:49.743479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:49Z,description='Default security group',id=75aeb1ed-1a22-41f7-90d4-ea7736c165c0,is_default=True,name='default',project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',revision_number=1,rules=[SecurityGroupRule(60d8886c-e6bc-4d87-b075-3b3572d6404d),SecurityGroupRule(6fd04033-887e-458c-97be-e3188f208282),SecurityGroupRule(aac5e247-dfba-4f7a-857d-ad3fc6cc0a76),SecurityGroupRule(c72d44aa-19bb-44f3-b1ca-517c2560dde7)],shared=False,stateful=True,updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.743855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (75aeb1ed-1a22-41f7-90d4-ea7736c165c0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.744697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:49Z,description=,direction='ingress',ethertype='IPv6',id=60d8886c-e6bc-4d87-b075-3b3572d6404d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',protocol=,remote_address_group_id=,remote_group_id=75aeb1ed-1a22-41f7-90d4-ea7736c165c0,remote_ip_prefix=,revision_number=0,security_group_id=75aeb1ed-1a22-41f7-90d4-ea7736c165c0,updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.745237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (60d8886c-e6bc-4d87-b075-3b3572d6404d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.745573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 00:57:49.746347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:49Z,description=,direction='ingress',ethertype='IPv4',id=6fd04033-887e-458c-97be-e3188f208282,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',protocol=,remote_address_group_id=,remote_group_id=75aeb1ed-1a22-41f7-90d4-ea7736c165c0,remote_ip_prefix=,revision_number=0,security_group_id=75aeb1ed-1a22-41f7-90d4-ea7736c165c0,updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.746664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6fd04033-887e-458c-97be-e3188f208282), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.747121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 00:57:49.748074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:49Z,description=,direction='egress',ethertype='IPv6',id=aac5e247-dfba-4f7a-857d-ad3fc6cc0a76,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=75aeb1ed-1a22-41f7-90d4-ea7736c165c0,updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.748331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (aac5e247-dfba-4f7a-857d-ad3fc6cc0a76), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.748790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 00:57:49.749498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:49Z,description=,direction='egress',ethertype='IPv4',id=c72d44aa-19bb-44f3-b1ca-517c2560dde7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=75aeb1ed-1a22-41f7-90d4-ea7736c165c0,updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:49.752600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c72d44aa-19bb-44f3-b1ca-517c2560dde7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.753136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 00:57:49.909450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:307 started Oct 23 00:57:49.913688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=983000000,duration_sec=630,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:49.914790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:49.915881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:307 - starting polling. Elapsed:0.007 Oct 23 00:57:49.919057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:49.930758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:307 - port information retrieved. Elapsed:0.018 Oct 23 00:57:49.931458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'3f16f421-4b09-4db8-bb39-036024ad1e08', 'ec2a1257-8a89-482a-b313-cba09c2f2203'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:49.932384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:46Z,data_plane_status=None,description='',device_id='ccc4a4a5-6896-45a8-ac65-8e16513ab31f',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3f16f421-4b09-4db8-bb39-036024ad1e08,mac_address=fa:16:3e:c8:e9:92,name='',network_id=a82fecef-3e22-41fa-8192-25cadd682e03,numa_affinity_policy=,project_id='2b5536e4b945479e8972cb5a95f60324',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(3f16f421-4b09-4db8-bb39-036024ad1e08),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:57:47Z) is not bound. Oct 23 00:57:49.933462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'mac_address': 'fa:16:3e:57:e0:52', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:49.942153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 3f16f421-4b09-4db8-bb39-036024ad1e08 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:49.942760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device 3f16f421-4b09-4db8-bb39-036024ad1e08 not defined on plugin or binding failed Oct 23 00:57:49.943576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: ec2a1257-8a89-482a-b313-cba09c2f2203 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:49.944095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port ec2a1257-8a89-482a-b313-cba09c2f2203 updated. Details: {'device': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'mac_address': 'fa:16:3e:57:e0:52', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:57:49.945377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ec2a1257-8a, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:49.945988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ec2a1257-8a, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:49.946623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ec2a1257-8a, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:49.958956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ec2a1257-8a, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:49.984044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b2c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:49.984782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:307 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.053 Oct 23 00:57:49.985321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 2 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:57:49.985812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'3f16f421-4b09-4db8-bb39-036024ad1e08', 'ec2a1257-8a89-482a-b313-cba09c2f2203'} Oct 23 00:57:49.987595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:49.991270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:50.006319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:50.038769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:57:49Z,description='',dns_domain=None,id=570809ed-8943-4319-88c0-71a523125321,mtu=1500,name='tempest-TestMinimumBasicScenario-1967240383-network',project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(570809ed-8943-4319-88c0-71a523125321),segments=[NetworkSegment(2b9d467c-782f-40c8-a5d1-155616573f38)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:57:49Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:50.039193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (570809ed-8943-4319-88c0-71a523125321), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:50.090508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf52a80-a0f9-4776-89c7-f77c1dd7da39]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:50.091276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:307 - agent port security group processed in 0.159 Oct 23 00:57:50.092517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for ec2a1257-8a89-482a-b313-cba09c2f2203 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-a269ce14-74d4-4337-ac9a-f2e7ca807e98 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 570809ed-8943-4319-88c0-71a523125321 with segmentation id not found. Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:57:50.164679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:57:50.165692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:57:50.165692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:57:50.165692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:57:50.165692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 570809ed-8943-4319-88c0-71a523125321 with segmentation id not found. Oct 23 00:57:50.165692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:57:50.336766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['ec2a1257-8a89-482a-b313-cba09c2f2203'] and devices down [] completed. Oct 23 00:57:50.337508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:307 - ports processed. Elapsed:0.428 Oct 23 00:57:50.339138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:307 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.430 Oct 23 00:57:50.429144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port ec2a1257-8a89-482a-b313-cba09c2f2203 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ec2a1257-8a89-482a-b313-cba09c2f2203,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ec2a1257-8a89-482a-b313-cba09c2f2203,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:50.429538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ec2a1257-8a89-482a-b313-cba09c2f2203), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:50.461693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-908de671-fb3f-4273-9a75-55fd65723e55 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(24007ddc-90f8-4f9b-9338-742c63a57745)],cidr=172.20.0.0/28,created_at=2022-10-23T00:57:50Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=f8f208d0-6d73-485f-ba6c-97c3f7122b3d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-1967240383-subnet',network_id=570809ed-8943-4319-88c0-71a523125321,project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:57:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:50.462067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-908de671-fb3f-4273-9a75-55fd65723e55 admin admin] Publish callbacks [] for Subnet (f8f208d0-6d73-485f-ba6c-97c3f7122b3d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:50.726967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-216127e1-ad56-41cd-83ee-dc677dd88704 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:49Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=429a622c-7d0f-4dfa-9be6-a7e9e54da9b0,mac_address=fa:16:3e:19:aa:35,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(429a622c-7d0f-4dfa-9be6-a7e9e54da9b0),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T00:57:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:50.728442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-216127e1-ad56-41cd-83ee-dc677dd88704 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (429a622c-7d0f-4dfa-9be6-a7e9e54da9b0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:51.151993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f6730569-07bb-4264-a8ab-ba17c569c7c5 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:50Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=48775c5f-c233-451e-b0b1-c1b30cd592d6,mac_address=fa:16:3e:da:de:32,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(48775c5f-c233-451e-b0b1-c1b30cd592d6),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T00:57:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:51.153125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f6730569-07bb-4264-a8ab-ba17c569c7c5 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (48775c5f-c233-451e-b0b1-c1b30cd592d6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:51.284954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-758c029b-13d4-4f39-888a-7249554b6d2b None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:50Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-570809ed-8943-4319-88c0-71a523125321',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f,mac_address=fa:16:3e:21:6e:f1,name='',network_id=570809ed-8943-4319-88c0-71a523125321,numa_affinity_policy=,project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:57:51Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:51.285315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-758c029b-13d4-4f39-888a-7249554b6d2b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:51.511694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-216127e1-ad56-41cd-83ee-dc677dd88704 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource Port 429a622c-7d0f-4dfa-9be6-a7e9e54da9b0 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'c771d886-1a14-4161-a7e1-ca944e783e9d'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:51.512332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-216127e1-ad56-41cd-83ee-dc677dd88704 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (429a622c-7d0f-4dfa-9be6-a7e9e54da9b0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:51.641504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-758c029b-13d4-4f39-888a-7249554b6d2b None None] Resource Port 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f,segment=NetworkSegment(2b9d467c-782f-40c8-a5d1-155616573f38),segment_id=2b9d467c-782f-40c8-a5d1-155616573f38)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:51.642164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-758c029b-13d4-4f39-888a-7249554b6d2b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:51.815574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["eeb5eb1b-8e44-4f3d-831d-ca2f0a92c686","insert","tap38b46ed1-c8",["set",[]],["map",[["attached-mac","fa:16:3e:21:6e:f1"],["iface-id","38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:51.832958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["eeb5eb1b-8e44-4f3d-831d-ca2f0a92c686","old",null,["set",[]],null],["","new","tap38b46ed1-c8",27,["map",[["attached-mac","fa:16:3e:21:6e:f1"],["iface-id","38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:51.913987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e07c7f36-604a-4f93-aa4d-7e70e7097f83 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:51Z,data_plane_status=None,description='',device_id='b43e72ec-e74f-4b3d-8313-064f4596d699',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=41fed497-9616-4065-81c5-649cbe8895a8,mac_address=fa:16:3e:62:f3:e3,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(41fed497-9616-4065-81c5-649cbe8895a8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:57:51Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:51.914373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e07c7f36-604a-4f93-aa4d-7e70e7097f83 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (41fed497-9616-4065-81c5-649cbe8895a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:51.920751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:308 started Oct 23 00:57:51.929407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=999000000,duration_sec=632,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:51.932068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:51.937752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:308 - starting polling. Elapsed:0.015 Oct 23 00:57:51.942427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:51.947684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:308 - port information retrieved. Elapsed:0.029 Oct 23 00:57:51.948236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f'}, 'removed': set(), 'updated': {'38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'ec2a1257-8a89-482a-b313-cba09c2f2203'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:51.949063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-570809ed-8943-4319-88c0-71a523125321', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'mac_address': 'fa:16:3e:21:6e:f1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:51.949754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'mac_address': 'fa:16:3e:57:e0:52', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:51.961820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:51.962680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f updated. Details: {'device': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-570809ed-8943-4319-88c0-71a523125321', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'mac_address': 'fa:16:3e:21:6e:f1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 00:57:51.963632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 11 as local vlan for net-id=570809ed-8943-4319-88c0-71a523125321, seg-id=363 Oct 23 00:57:51.969115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1321193d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4459), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:51.986946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2b30,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4107)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4459}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:51.990999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap38b46ed1-c8, col_values=(('tag', 11),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:51.991941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap38b46ed1-c8, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:51.994731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap38b46ed1-c8, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:52.003620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap38b46ed1-c8, col_values=(('other_config', {'net_uuid': '570809ed-8943-4319-88c0-71a523125321', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '363'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:52.017435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b32,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:52.018551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: ec2a1257-8a89-482a-b313-cba09c2f2203 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:52.019056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port ec2a1257-8a89-482a-b313-cba09c2f2203 updated. Details: {'device': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ec2a1257-8a89-482a-b313-cba09c2f2203', 'mac_address': 'fa:16:3e:57:e0:52', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:57:52.020304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ec2a1257-8a, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:52.020994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ec2a1257-8a, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:52.021586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ec2a1257-8a, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:52.022612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:52.024606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ec2a1257-8a, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:52.026747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:52.030534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b34,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:52.031118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:308 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.082 Oct 23 00:57:52.031626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:57:52.032070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f'} Oct 23 00:57:52.034348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:52.034924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:52.042412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:52.125197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[306547bd-ea10-4b6d-8cdc-b81b1484619b]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:52.125895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:57:52.126917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:57:52.128579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:52.128916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:52.135076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:52.233103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[da57ddff-ff29-4537-946b-d6215a29862d]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:52.233735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:308 - agent port security group processed in 0.285 Oct 23 00:57:52.234717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:52.235013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for ec2a1257-8a89-482a-b313-cba09c2f2203 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:52.448988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3b7f88f2-3844-4c12-a874-ebb6efff5b45 None None] Resource Port 3f16f421-4b09-4db8-bb39-036024ad1e08 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=3f16f421-4b09-4db8-bb39-036024ad1e08,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3f16f421-4b09-4db8-bb39-036024ad1e08,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:52.448988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3b7f88f2-3844-4c12-a874-ebb6efff5b45 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3f16f421-4b09-4db8-bb39-036024ad1e08), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:52.486503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f6730569-07bb-4264-a8ab-ba17c569c7c5 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port 48775c5f-c233-451e-b0b1-c1b30cd592d6 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '16a4e4c8-3010-46c1-840f-64a761ad31b8'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:52.487302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f6730569-07bb-4264-a8ab-ba17c569c7c5 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (48775c5f-c233-451e-b0b1-c1b30cd592d6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:52.613816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:52.614415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:52.765408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'ec2a1257-8a89-482a-b313-cba09c2f2203'] and devices down [] completed. Oct 23 00:57:52.765849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:308 - ports processed. Elapsed:0.847 Oct 23 00:57:52.766277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:308 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.848 Oct 23 00:57:52.864646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3b7f88f2-3844-4c12-a874-ebb6efff5b45 None None] Resource Port 3f16f421-4b09-4db8-bb39-036024ad1e08 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3f16f421-4b09-4db8-bb39-036024ad1e08,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3f16f421-4b09-4db8-bb39-036024ad1e08,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3f16f421-4b09-4db8-bb39-036024ad1e08,segment=NetworkSegment(cddd1db6-cf69-4403-969b-c4a8db3f5024),segment_id=cddd1db6-cf69-4403-969b-c4a8db3f5024)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:52.865755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3b7f88f2-3844-4c12-a874-ebb6efff5b45 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3f16f421-4b09-4db8-bb39-036024ad1e08), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:53.920275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:309 started Oct 23 00:57:53.924069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=995000000,duration_sec=634,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:53.924904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:53.925565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:309 - starting polling. Elapsed:0.005 Oct 23 00:57:53.930838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:53.941889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:309 - port information retrieved. Elapsed:0.022 Oct 23 00:57:53.943319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'3f16f421-4b09-4db8-bb39-036024ad1e08', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:53.944084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'mac_address': 'fa:16:3e:c8:e9:92', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:53.944834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-570809ed-8943-4319-88c0-71a523125321', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'mac_address': 'fa:16:3e:21:6e:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:53.953163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 3f16f421-4b09-4db8-bb39-036024ad1e08 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:53.953515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 3f16f421-4b09-4db8-bb39-036024ad1e08 updated. Details: {'device': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'mac_address': 'fa:16:3e:c8:e9:92', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 23 00:57:53.954567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3f16f421-4b, col_values=(('tag', 10),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:53.954995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-3f16f421-4b, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:53.955431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-3f16f421-4b, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:53.975745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3f16f421-4b, col_values=(('other_config', {'net_uuid': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '390'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:53.991045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b38,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:53.993558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:53.995307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f updated. Details: {'device': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-570809ed-8943-4319-88c0-71a523125321', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', 'mac_address': 'fa:16:3e:21:6e:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 23 00:57:53.996918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap38b46ed1-c8, col_values=(('tag', 11),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:53.999832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap38b46ed1-c8, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:54.000518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap38b46ed1-c8, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:54.001106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:54.003706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap38b46ed1-c8, col_values=(('other_config', {'net_uuid': '570809ed-8943-4319-88c0-71a523125321', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '363', 'tag': '11'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:54.006983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:54.025757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b3a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:54.027015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:309 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.083 Oct 23 00:57:54.027483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 2 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:57:54.027870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:57:54.030487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:54.031023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:54.037253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:54.101882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[270d0f85-10e0-45be-8bd9-cc741abb3134]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:54.102514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:309 - agent port security group processed in 0.159 Oct 23 00:57:54.103419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 3f16f421-4b09-4db8-bb39-036024ad1e08 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:54.103708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:54.852304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 3f16f421-4b09-4db8-bb39-036024ad1e08 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:54.852943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3f16f421-4b09-4db8-bb39-036024ad1e08), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:55.048920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edcfb203-d21c-4571-9f9b-b8b9c96d1098 None None] Resource Port 41fed497-9616-4065-81c5-649cbe8895a8 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=41fed497-9616-4065-81c5-649cbe8895a8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=41fed497-9616-4065-81c5-649cbe8895a8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:55.050444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edcfb203-d21c-4571-9f9b-b8b9c96d1098 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (41fed497-9616-4065-81c5-649cbe8895a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:55.054876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['3f16f421-4b09-4db8-bb39-036024ad1e08', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f'] and devices down [] completed. Oct 23 00:57:55.055311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:309 - ports processed. Elapsed:1.135 Oct 23 00:57:55.055792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:309 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:1.136 Oct 23 00:57:55.395530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edcfb203-d21c-4571-9f9b-b8b9c96d1098 None None] Resource Port 41fed497-9616-4065-81c5-649cbe8895a8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=41fed497-9616-4065-81c5-649cbe8895a8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=41fed497-9616-4065-81c5-649cbe8895a8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=41fed497-9616-4065-81c5-649cbe8895a8,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:55.396269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edcfb203-d21c-4571-9f9b-b8b9c96d1098 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (41fed497-9616-4065-81c5-649cbe8895a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:55.620081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc348ad8-8ee5-43cf-8e8a-9735f0c494db admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:55Z,data_plane_status=None,description='',device_id='b43e72ec-e74f-4b3d-8313-064f4596d699',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4a7cd454-b41b-4353-a8da-dd92a4f996c1,mac_address=fa:16:3e:95:5b:14,name='',network_id=570809ed-8943-4319-88c0-71a523125321,numa_affinity_policy=,project_id='5e0dff1e22fd436e8ed3a395d94ef8ce',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4a7cd454-b41b-4353-a8da-dd92a4f996c1),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T00:57:55Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:55.620464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc348ad8-8ee5-43cf-8e8a-9735f0c494db admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (4a7cd454-b41b-4353-a8da-dd92a4f996c1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:55.921531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:310 started Oct 23 00:57:55.924612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=995000000,duration_sec=636,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:55.925272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:55.925711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:310 - starting polling. Elapsed:0.004 Oct 23 00:57:55.928697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:55.936769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:310 - port information retrieved. Elapsed:0.015 Oct 23 00:57:55.956012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'3f16f421-4b09-4db8-bb39-036024ad1e08'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:55.956752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'mac_address': 'fa:16:3e:c8:e9:92', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:55.969704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 3f16f421-4b09-4db8-bb39-036024ad1e08 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:55.970057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 3f16f421-4b09-4db8-bb39-036024ad1e08 updated. Details: {'device': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'device_id': 'ccc4a4a5-6896-45a8-ac65-8e16513ab31f', 'network_id': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'port_id': '3f16f421-4b09-4db8-bb39-036024ad1e08', 'mac_address': 'fa:16:3e:c8:e9:92', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '943dfaf8-c12c-409b-b313-a2e572eba44f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 23 00:57:55.973834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3f16f421-4b, col_values=(('tag', 10),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:55.974287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-3f16f421-4b, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:55.974699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-3f16f421-4b, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:55.975305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:55.976311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3f16f421-4b, col_values=(('other_config', {'net_uuid': 'a82fecef-3e22-41fa-8192-25cadd682e03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '390', 'tag': '10'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:55.977661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:55.991276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b3e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:55.992174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:310 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.036 Oct 23 00:57:55.993184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:57:55.993549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:57:55.994816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:55.995167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:56.007190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:56.095426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc92365-5488-4e2d-8f6a-1c2e7f04f396]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:56.098032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:310 - agent port security group processed in 0.141 Oct 23 00:57:56.099627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 3f16f421-4b09-4db8-bb39-036024ad1e08 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:56.189232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["67bc42f3-0436-4f67-9928-48d258a43720","insert","qg-41fed497-96",["set",[]],["map",[["attached-mac","fa:16:3e:62:f3:e3"],["iface-id","41fed497-9616-4065-81c5-649cbe8895a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:56.215092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["67bc42f3-0436-4f67-9928-48d258a43720","old",null,["set",[]],null],["","new","qg-41fed497-96",28,["map",[["attached-mac","fa:16:3e:62:f3:e3"],["iface-id","41fed497-9616-4065-81c5-649cbe8895a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:57:56.321618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['3f16f421-4b09-4db8-bb39-036024ad1e08'] and devices down [] completed. Oct 23 00:57:56.321943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:310 - ports processed. Elapsed:0.401 Oct 23 00:57:56.322269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:310 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.401 Oct 23 00:57:56.489651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc348ad8-8ee5-43cf-8e8a-9735f0c494db admin admin] Received resource Port update without any changes: 4a7cd454-b41b-4353-a8da-dd92a4f996c1 {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 00:57:57.922787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:311 started Oct 23 00:57:57.926232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=997000000,duration_sec=638,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:57.926821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:57.927289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:311 - starting polling. Elapsed:0.005 Oct 23 00:57:57.930631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:57.934943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:311 - port information retrieved. Elapsed:0.012 Oct 23 00:57:57.935646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '41fed497-9616-4065-81c5-649cbe8895a8', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'41fed497-9616-4065-81c5-649cbe8895a8'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:57.935875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '41fed497-9616-4065-81c5-649cbe8895a8', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '41fed497-9616-4065-81c5-649cbe8895a8', 'mac_address': 'fa:16:3e:62:f3:e3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.76'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:57.940614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 41fed497-9616-4065-81c5-649cbe8895a8 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:57.940987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 41fed497-9616-4065-81c5-649cbe8895a8 updated. Details: {'device': '41fed497-9616-4065-81c5-649cbe8895a8', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '41fed497-9616-4065-81c5-649cbe8895a8', 'mac_address': 'fa:16:3e:62:f3:e3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.76'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:57:57.941993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41fed497-96, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:57.942414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-41fed497-96, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:57.943145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-41fed497-96, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:57.955872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41fed497-96, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:57.968671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b42,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:57.969416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:311 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 24 devices currently available. Time elapsed: 0.034 Oct 23 00:57:57.969777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:57:57.970227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'41fed497-9616-4065-81c5-649cbe8895a8'} Oct 23 00:57:57.971706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:57.972059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:57:57.978748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:57:58.051138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[233eb879-9bbb-493c-a73d-f3a37fde8942]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:57:58.052060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:311 - agent port security group processed in 0.116 Oct 23 00:57:58.053296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 41fed497-9616-4065-81c5-649cbe8895a8 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:57:58.270789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['41fed497-9616-4065-81c5-649cbe8895a8'] and devices down [] completed. Oct 23 00:57:58.271379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:311 - ports processed. Elapsed:0.349 Oct 23 00:57:58.271849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:311 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.349 Oct 23 00:57:58.374432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 41fed497-9616-4065-81c5-649cbe8895a8 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=41fed497-9616-4065-81c5-649cbe8895a8,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=41fed497-9616-4065-81c5-649cbe8895a8,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:58.374830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (41fed497-9616-4065-81c5-649cbe8895a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:58.589124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5a996f26-c21b-4778-a1be-f4c3c3f6c10b tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:57:57Z,data_plane_status=None,description='',device_id='ccd36ab6-014d-49b2-9a79-8a4fe655caf0',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=77da0074-6006-4aa3-98e5-60bc673f4b72,mac_address=fa:16:3e:d2:75:0c,name='',network_id=1d27b6d9-fef6-49cb-833f-13cb9578958e,numa_affinity_policy=,project_id='94cfcbd6f144492d8be27fe35cbe76d5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(77da0074-6006-4aa3-98e5-60bc673f4b72),security_group_ids=set([2024e950-6bc4-4c6f-8358-200660ce4c9f]),status='DOWN',updated_at=2022-10-23T00:57:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:57:58.589723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5a996f26-c21b-4778-a1be-f4c3c3f6c10b tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (77da0074-6006-4aa3-98e5-60bc673f4b72), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:58.591230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5a996f26-c21b-4778-a1be-f4c3c3f6c10b tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group member updated {'2024e950-6bc4-4c6f-8358-200660ce4c9f'} Oct 23 00:57:59.587171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-420d0d29-40b9-439e-9586-a21a52816ed7 service neutron] Resource Port 77da0074-6006-4aa3-98e5-60bc673f4b72 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=77da0074-6006-4aa3-98e5-60bc673f4b72,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=77da0074-6006-4aa3-98e5-60bc673f4b72,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:57:59.589963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-420d0d29-40b9-439e-9586-a21a52816ed7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (77da0074-6006-4aa3-98e5-60bc673f4b72), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:59.924143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:312 started Oct 23 00:57:59.929622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=998000000,duration_sec=640,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:59.930560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:57:59.931097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:312 - starting polling. Elapsed:0.007 Oct 23 00:57:59.934813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:57:59.942002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:312 - port information retrieved. Elapsed:0.018 Oct 23 00:57:59.942944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '41fed497-9616-4065-81c5-649cbe8895a8', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'41fed497-9616-4065-81c5-649cbe8895a8'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:57:59.943737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '41fed497-9616-4065-81c5-649cbe8895a8', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '41fed497-9616-4065-81c5-649cbe8895a8', 'mac_address': 'fa:16:3e:62:f3:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.76'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:57:59.950182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 41fed497-9616-4065-81c5-649cbe8895a8 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:57:59.950936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 41fed497-9616-4065-81c5-649cbe8895a8 updated. Details: {'device': '41fed497-9616-4065-81c5-649cbe8895a8', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '41fed497-9616-4065-81c5-649cbe8895a8', 'mac_address': 'fa:16:3e:62:f3:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.76'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 00:57:59.958610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41fed497-96, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:59.959743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-41fed497-96, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:59.960365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-41fed497-96, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:59.961144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:59.962359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41fed497-96, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:57:59.963653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:57:59.985919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b46,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:57:59.988418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:312 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 24 devices currently available. Time elapsed: 0.043 Oct 23 00:57:59.990348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:57:59.991270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:57:59.995846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:57:59.996493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:58:00.015053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:58:00.114551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f176d-9789-40ad-99ea-e31fac85f429]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:58:00.115155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:312 - agent port security group processed in 0.172 Oct 23 00:58:00.116112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 41fed497-9616-4065-81c5-649cbe8895a8 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:58:00.257777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:57:59Z,description='Default security group',id=c6dde777-7c2b-4783-b004-738b2c81511a,is_default=True,name='default',project_id='bacbfdb2d81f43208a441c865a09e041',revision_number=1,rules=[SecurityGroupRule(2494e049-ac5e-45cc-832a-67a6440b24b4),SecurityGroupRule(6e50fbc6-2b38-41ed-a501-69f20298f9dc),SecurityGroupRule(82e7f7ac-d017-4bc1-bdd4-a5e1d2b27ff6),SecurityGroupRule(aad3f968-f13a-4f3d-873b-bf714c9c09b4)],shared=False,stateful=True,updated_at=2022-10-23T00:57:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:00.258338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (c6dde777-7c2b-4783-b004-738b2c81511a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.259156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:59Z,description=,direction='egress',ethertype='IPv4',id=2494e049-ac5e-45cc-832a-67a6440b24b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bacbfdb2d81f43208a441c865a09e041',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c6dde777-7c2b-4783-b004-738b2c81511a,updated_at=2022-10-23T00:57:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:00.259630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2494e049-ac5e-45cc-832a-67a6440b24b4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.259973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:00.261168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:59Z,description=,direction='ingress',ethertype='IPv6',id=6e50fbc6-2b38-41ed-a501-69f20298f9dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bacbfdb2d81f43208a441c865a09e041',protocol=,remote_address_group_id=,remote_group_id=c6dde777-7c2b-4783-b004-738b2c81511a,remote_ip_prefix=,revision_number=0,security_group_id=c6dde777-7c2b-4783-b004-738b2c81511a,updated_at=2022-10-23T00:57:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:00.261705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6e50fbc6-2b38-41ed-a501-69f20298f9dc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.262045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:00.262924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:59Z,description=,direction='egress',ethertype='IPv6',id=82e7f7ac-d017-4bc1-bdd4-a5e1d2b27ff6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bacbfdb2d81f43208a441c865a09e041',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c6dde777-7c2b-4783-b004-738b2c81511a,updated_at=2022-10-23T00:57:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:00.263283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (82e7f7ac-d017-4bc1-bdd4-a5e1d2b27ff6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.265166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:00.267257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:57:59Z,description=,direction='ingress',ethertype='IPv4',id=aad3f968-f13a-4f3d-873b-bf714c9c09b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bacbfdb2d81f43208a441c865a09e041',protocol=,remote_address_group_id=,remote_group_id=c6dde777-7c2b-4783-b004-738b2c81511a,remote_ip_prefix=,revision_number=0,security_group_id=c6dde777-7c2b-4783-b004-738b2c81511a,updated_at=2022-10-23T00:57:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:00.268904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (aad3f968-f13a-4f3d-873b-bf714c9c09b4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.269261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-827becd2-2e9d-4552-b378-39929f8ac8bb admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:00.519859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Resource SecurityGroup deleted: c6dde777-7c2b-4783-b004-738b2c81511a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:00.520240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (c6dde777-7c2b-4783-b004-738b2c81511a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.520705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c6dde777-7c2b-4783-b004-738b2c81511a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:00.604807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb5706bf-c977-4fc3-bf2e-685981d085c5 None None] Resource Port 4a7cd454-b41b-4353-a8da-dd92a4f996c1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=4a7cd454-b41b-4353-a8da-dd92a4f996c1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4a7cd454-b41b-4353-a8da-dd92a4f996c1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:00.605498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb5706bf-c977-4fc3-bf2e-685981d085c5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (4a7cd454-b41b-4353-a8da-dd92a4f996c1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.886578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c6dde777-7c2b-4783-b004-738b2c81511a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:00.887343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Resource SecurityGroupRule deleted: 2494e049-ac5e-45cc-832a-67a6440b24b4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:00.888003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2494e049-ac5e-45cc-832a-67a6440b24b4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.888825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:00.889531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Resource SecurityGroupRule deleted: 6e50fbc6-2b38-41ed-a501-69f20298f9dc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:00.889993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6e50fbc6-2b38-41ed-a501-69f20298f9dc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.890620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:00.891252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Resource SecurityGroupRule deleted: 82e7f7ac-d017-4bc1-bdd4-a5e1d2b27ff6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:00.891746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (82e7f7ac-d017-4bc1-bdd4-a5e1d2b27ff6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.892263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:00.892897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Resource SecurityGroupRule deleted: aad3f968-f13a-4f3d-873b-bf714c9c09b4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:00.893391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (aad3f968-f13a-4f3d-873b-bf714c9c09b4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:00.893906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-56c96b31-a0dd-4e13-9412-44d21a91303e admin admin] Security group rule updated ['c6dde777-7c2b-4783-b004-738b2c81511a'] Oct 23 00:58:01.026453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['41fed497-9616-4065-81c5-649cbe8895a8'] and devices down [] completed. Oct 23 00:58:01.026973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:312 - ports processed. Elapsed:1.103 Oct 23 00:58:01.027410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:312 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.103 Oct 23 00:58:01.050945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:00Z,description='Default security group',id=3ed326a9-38c1-4213-91e1-dfa2ab645b29,is_default=True,name='default',project_id='00f095fcf0984502ac2ab4fe27880081',revision_number=1,rules=[SecurityGroupRule(0c7cdb37-c945-4259-838b-5c85e99d2edf),SecurityGroupRule(9109c103-701e-47ef-af06-3c16e187c938),SecurityGroupRule(ab50e8be-2357-48dd-b079-636706b6155d),SecurityGroupRule(b9118135-a57c-4a3b-b69d-8a4c52299e25)],shared=False,stateful=True,updated_at=2022-10-23T00:58:00Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:01.051334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (3ed326a9-38c1-4213-91e1-dfa2ab645b29), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.052159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:00Z,description=,direction='egress',ethertype='IPv6',id=0c7cdb37-c945-4259-838b-5c85e99d2edf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='00f095fcf0984502ac2ab4fe27880081',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3ed326a9-38c1-4213-91e1-dfa2ab645b29,updated_at=2022-10-23T00:58:00Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:01.052626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0c7cdb37-c945-4259-838b-5c85e99d2edf), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.052995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.053812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:00Z,description=,direction='ingress',ethertype='IPv4',id=9109c103-701e-47ef-af06-3c16e187c938,normalized_cidr=None,port_range_max=,port_range_min=,project_id='00f095fcf0984502ac2ab4fe27880081',protocol=,remote_address_group_id=,remote_group_id=3ed326a9-38c1-4213-91e1-dfa2ab645b29,remote_ip_prefix=,revision_number=0,security_group_id=3ed326a9-38c1-4213-91e1-dfa2ab645b29,updated_at=2022-10-23T00:58:00Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:01.054203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9109c103-701e-47ef-af06-3c16e187c938), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.054549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.055198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:00Z,description=,direction='egress',ethertype='IPv4',id=ab50e8be-2357-48dd-b079-636706b6155d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='00f095fcf0984502ac2ab4fe27880081',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3ed326a9-38c1-4213-91e1-dfa2ab645b29,updated_at=2022-10-23T00:58:00Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:01.055552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ab50e8be-2357-48dd-b079-636706b6155d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.055880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.058417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:00Z,description=,direction='ingress',ethertype='IPv6',id=b9118135-a57c-4a3b-b69d-8a4c52299e25,normalized_cidr=None,port_range_max=,port_range_min=,project_id='00f095fcf0984502ac2ab4fe27880081',protocol=,remote_address_group_id=,remote_group_id=3ed326a9-38c1-4213-91e1-dfa2ab645b29,remote_ip_prefix=,revision_number=0,security_group_id=3ed326a9-38c1-4213-91e1-dfa2ab645b29,updated_at=2022-10-23T00:58:00Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:01.058787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b9118135-a57c-4a3b-b69d-8a4c52299e25), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.059130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3abb75ba-29ea-4792-b24c-f31bf5e31ecb admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.134369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb5706bf-c977-4fc3-bf2e-685981d085c5 None None] Resource Port 4a7cd454-b41b-4353-a8da-dd92a4f996c1 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4a7cd454-b41b-4353-a8da-dd92a4f996c1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4a7cd454-b41b-4353-a8da-dd92a4f996c1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4a7cd454-b41b-4353-a8da-dd92a4f996c1,segment=NetworkSegment(2b9d467c-782f-40c8-a5d1-155616573f38),segment_id=2b9d467c-782f-40c8-a5d1-155616573f38)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:01.134749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb5706bf-c977-4fc3-bf2e-685981d085c5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (4a7cd454-b41b-4353-a8da-dd92a4f996c1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.212304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-420d0d29-40b9-439e-9586-a21a52816ed7 service neutron] Resource Port 77da0074-6006-4aa3-98e5-60bc673f4b72 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=77da0074-6006-4aa3-98e5-60bc673f4b72,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=77da0074-6006-4aa3-98e5-60bc673f4b72,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=77da0074-6006-4aa3-98e5-60bc673f4b72,segment=NetworkSegment(63b58a73-ffd1-4018-ac3c-0db314c2c768),segment_id=63b58a73-ffd1-4018-ac3c-0db314c2c768)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:01.212755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-420d0d29-40b9-439e-9586-a21a52816ed7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (77da0074-6006-4aa3-98e5-60bc673f4b72), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.360661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Resource SecurityGroup deleted: 3ed326a9-38c1-4213-91e1-dfa2ab645b29 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:01.361064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (3ed326a9-38c1-4213-91e1-dfa2ab645b29), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.362031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3ed326a9-38c1-4213-91e1-dfa2ab645b29',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:01.386455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3ed326a9-38c1-4213-91e1-dfa2ab645b29',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:01.387609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Resource SecurityGroupRule deleted: 0c7cdb37-c945-4259-838b-5c85e99d2edf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:01.388645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0c7cdb37-c945-4259-838b-5c85e99d2edf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.389233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.389825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Resource SecurityGroupRule deleted: 9109c103-701e-47ef-af06-3c16e187c938 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:01.390367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9109c103-701e-47ef-af06-3c16e187c938), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.391990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.393090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Resource SecurityGroupRule deleted: ab50e8be-2357-48dd-b079-636706b6155d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:01.393634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ab50e8be-2357-48dd-b079-636706b6155d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.394128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.394736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Resource SecurityGroupRule deleted: b9118135-a57c-4a3b-b69d-8a4c52299e25 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:01.395247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b9118135-a57c-4a3b-b69d-8a4c52299e25), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.395570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-544d712f-fc24-4033-b200-0e108b54c30a admin admin] Security group rule updated ['3ed326a9-38c1-4213-91e1-dfa2ab645b29'] Oct 23 00:58:01.669586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["494ed58a-b60e-4657-91c4-9d2ffa63ff5b","insert","qr-4a7cd454-b4",["set",[]],["map",[["attached-mac","fa:16:3e:95:5b:14"],["iface-id","4a7cd454-b41b-4353-a8da-dd92a4f996c1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:58:01.673445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["494ed58a-b60e-4657-91c4-9d2ffa63ff5b","old",null,["set",[]],null],["","new","qr-4a7cd454-b4",29,["map",[["attached-mac","fa:16:3e:95:5b:14"],["iface-id","4a7cd454-b41b-4353-a8da-dd92a4f996c1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 00:58:01.925764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:313 started Oct 23 00:58:01.931032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=1000000,duration_sec=643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:01.931652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:01.932283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:313 - starting polling. Elapsed:0.007 Oct 23 00:58:01.940478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:01.949581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:313 - port information retrieved. Elapsed:0.024 Oct 23 00:58:01.950133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '41fed497-9616-4065-81c5-649cbe8895a8', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'4a7cd454-b41b-4353-a8da-dd92a4f996c1'}, 'removed': set(), 'updated': {'4a7cd454-b41b-4353-a8da-dd92a4f996c1'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:58:01.951249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'mac_address': 'fa:16:3e:95:5b:14', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:58:01.958900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 4a7cd454-b41b-4353-a8da-dd92a4f996c1 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:58:01.959460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 4a7cd454-b41b-4353-a8da-dd92a4f996c1 updated. Details: {'device': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'mac_address': 'fa:16:3e:95:5b:14', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 23 00:58:01.961829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a7cd454-b4, col_values=(('tag', 11),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:01.962549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4a7cd454-b4, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:01.963140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4a7cd454-b4, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:01.969608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a7cd454-b4, col_values=(('other_config', {'net_uuid': '570809ed-8943-4319-88c0-71a523125321', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '363'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:02.017493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b4a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:02.018136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:313 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 25 devices currently available. Time elapsed: 0.067 Oct 23 00:58:02.018673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 00:58:02.019174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'4a7cd454-b41b-4353-a8da-dd92a4f996c1'} Oct 23 00:58:02.020523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:58:02.021016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:58:02.027408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:58:02.108347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9ea244-02e9-4806-8f68-17be71f23ef5]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:58:02.109226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:313 - agent port security group processed in 0.158 Oct 23 00:58:02.110467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 4a7cd454-b41b-4353-a8da-dd92a4f996c1 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:58:02.183584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:02Z,description='Default security group',id=35664b4e-8a1e-4a45-bfdf-5ba4ee11676f,is_default=True,name='default',project_id='b874d11bbadd4b0dbba8f0bdde979eaa',revision_number=1,rules=[SecurityGroupRule(128d7423-745d-46e6-ba86-2d40d911f28f),SecurityGroupRule(32080c0e-8224-472d-89d2-ce2633df7fe6),SecurityGroupRule(617bd418-2836-46b8-9a21-65e198bba4e9),SecurityGroupRule(c34cce88-69cf-4754-863d-d6f9ba98053f)],shared=False,stateful=True,updated_at=2022-10-23T00:58:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:02.184388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (35664b4e-8a1e-4a45-bfdf-5ba4ee11676f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.185315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:02Z,description=,direction='ingress',ethertype='IPv6',id=128d7423-745d-46e6-ba86-2d40d911f28f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b874d11bbadd4b0dbba8f0bdde979eaa',protocol=,remote_address_group_id=,remote_group_id=35664b4e-8a1e-4a45-bfdf-5ba4ee11676f,remote_ip_prefix=,revision_number=0,security_group_id=35664b4e-8a1e-4a45-bfdf-5ba4ee11676f,updated_at=2022-10-23T00:58:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:02.186466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (128d7423-745d-46e6-ba86-2d40d911f28f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.187699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:02.188617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:02Z,description=,direction='egress',ethertype='IPv4',id=32080c0e-8224-472d-89d2-ce2633df7fe6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b874d11bbadd4b0dbba8f0bdde979eaa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=35664b4e-8a1e-4a45-bfdf-5ba4ee11676f,updated_at=2022-10-23T00:58:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:02.189217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (32080c0e-8224-472d-89d2-ce2633df7fe6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.189737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:02.190593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:02Z,description=,direction='ingress',ethertype='IPv4',id=617bd418-2836-46b8-9a21-65e198bba4e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b874d11bbadd4b0dbba8f0bdde979eaa',protocol=,remote_address_group_id=,remote_group_id=35664b4e-8a1e-4a45-bfdf-5ba4ee11676f,remote_ip_prefix=,revision_number=0,security_group_id=35664b4e-8a1e-4a45-bfdf-5ba4ee11676f,updated_at=2022-10-23T00:58:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:02.191936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (617bd418-2836-46b8-9a21-65e198bba4e9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.198557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:02.200029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:02Z,description=,direction='egress',ethertype='IPv6',id=c34cce88-69cf-4754-863d-d6f9ba98053f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b874d11bbadd4b0dbba8f0bdde979eaa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=35664b4e-8a1e-4a45-bfdf-5ba4ee11676f,updated_at=2022-10-23T00:58:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:02.200869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c34cce88-69cf-4754-863d-d6f9ba98053f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.201884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cbf154ff-087f-4803-8dd5-0a63b7875ac8 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:02.431462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['4a7cd454-b41b-4353-a8da-dd92a4f996c1'] and devices down [] completed. Oct 23 00:58:02.431947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:313 - ports processed. Elapsed:0.507 Oct 23 00:58:02.432377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:313 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.507 Oct 23 00:58:02.550387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 4a7cd454-b41b-4353-a8da-dd92a4f996c1 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:02.550777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (4a7cd454-b41b-4353-a8da-dd92a4f996c1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.556478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Resource SecurityGroup deleted: 35664b4e-8a1e-4a45-bfdf-5ba4ee11676f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:02.557197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (35664b4e-8a1e-4a45-bfdf-5ba4ee11676f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.557890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('35664b4e-8a1e-4a45-bfdf-5ba4ee11676f',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:02.581341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('35664b4e-8a1e-4a45-bfdf-5ba4ee11676f',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:02.581866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Resource SecurityGroupRule deleted: 128d7423-745d-46e6-ba86-2d40d911f28f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:02.582237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (128d7423-745d-46e6-ba86-2d40d911f28f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.582572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:02.582967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Resource SecurityGroupRule deleted: 32080c0e-8224-472d-89d2-ce2633df7fe6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:02.583311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (32080c0e-8224-472d-89d2-ce2633df7fe6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.583633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:02.584085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Resource SecurityGroupRule deleted: 617bd418-2836-46b8-9a21-65e198bba4e9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:02.584336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (617bd418-2836-46b8-9a21-65e198bba4e9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.584657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:02.585131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Resource SecurityGroupRule deleted: c34cce88-69cf-4754-863d-d6f9ba98053f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:02.585469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c34cce88-69cf-4754-863d-d6f9ba98053f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:02.585788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a16d76df-5864-4955-a2e8-7994871264d1 admin admin] Security group rule updated ['35664b4e-8a1e-4a45-bfdf-5ba4ee11676f'] Oct 23 00:58:03.309406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:03Z,description='Default security group',id=4679f716-4331-4033-afda-8b32e1844623,is_default=True,name='default',project_id='43be48cd99b4438cbe74acd73e1e1cba',revision_number=1,rules=[SecurityGroupRule(24ab2122-396a-4f08-be24-93001b67da77),SecurityGroupRule(380fb1cd-261b-4c5a-ae88-8cfef971dad6),SecurityGroupRule(46649842-5edc-4d75-8897-84dea10c1af9),SecurityGroupRule(48d6d190-743a-4299-a4fa-f75295edf1e5)],shared=False,stateful=True,updated_at=2022-10-23T00:58:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:03.310355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (4679f716-4331-4033-afda-8b32e1844623), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.310703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:03Z,description=,direction='egress',ethertype='IPv6',id=24ab2122-396a-4f08-be24-93001b67da77,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43be48cd99b4438cbe74acd73e1e1cba',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4679f716-4331-4033-afda-8b32e1844623,updated_at=2022-10-23T00:58:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:03.311345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (24ab2122-396a-4f08-be24-93001b67da77), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.311826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.312776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:03Z,description=,direction='ingress',ethertype='IPv4',id=380fb1cd-261b-4c5a-ae88-8cfef971dad6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43be48cd99b4438cbe74acd73e1e1cba',protocol=,remote_address_group_id=,remote_group_id=4679f716-4331-4033-afda-8b32e1844623,remote_ip_prefix=,revision_number=0,security_group_id=4679f716-4331-4033-afda-8b32e1844623,updated_at=2022-10-23T00:58:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:03.313379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (380fb1cd-261b-4c5a-ae88-8cfef971dad6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.313948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.314798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:03Z,description=,direction='ingress',ethertype='IPv6',id=46649842-5edc-4d75-8897-84dea10c1af9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43be48cd99b4438cbe74acd73e1e1cba',protocol=,remote_address_group_id=,remote_group_id=4679f716-4331-4033-afda-8b32e1844623,remote_ip_prefix=,revision_number=0,security_group_id=4679f716-4331-4033-afda-8b32e1844623,updated_at=2022-10-23T00:58:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:03.315387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (46649842-5edc-4d75-8897-84dea10c1af9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.315919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.318079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:03Z,description=,direction='egress',ethertype='IPv4',id=48d6d190-743a-4299-a4fa-f75295edf1e5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43be48cd99b4438cbe74acd73e1e1cba',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4679f716-4331-4033-afda-8b32e1844623,updated_at=2022-10-23T00:58:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:03.320431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (48d6d190-743a-4299-a4fa-f75295edf1e5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.323323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ec8daab4-770f-4588-a209-7f533c9ad2b7 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.523992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Resource SecurityGroup deleted: 4679f716-4331-4033-afda-8b32e1844623 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:03.524460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (4679f716-4331-4033-afda-8b32e1844623), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.525002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4679f716-4331-4033-afda-8b32e1844623',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:03.544464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4679f716-4331-4033-afda-8b32e1844623',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:03.545210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Resource SecurityGroupRule deleted: 24ab2122-396a-4f08-be24-93001b67da77 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:03.545852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (24ab2122-396a-4f08-be24-93001b67da77), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.546221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.546781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Resource SecurityGroupRule deleted: 380fb1cd-261b-4c5a-ae88-8cfef971dad6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:03.547260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (380fb1cd-261b-4c5a-ae88-8cfef971dad6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.547770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.548543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Resource SecurityGroupRule deleted: 46649842-5edc-4d75-8897-84dea10c1af9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:03.549307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (46649842-5edc-4d75-8897-84dea10c1af9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.549605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.550052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Resource SecurityGroupRule deleted: 48d6d190-743a-4299-a4fa-f75295edf1e5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:03.550832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (48d6d190-743a-4299-a4fa-f75295edf1e5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.551355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-64ba5745-b319-4b8a-8d6f-a1a6d35843b8 admin admin] Security group rule updated ['4679f716-4331-4033-afda-8b32e1844623'] Oct 23 00:58:03.926579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:314 started Oct 23 00:58:03.929160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=0,duration_sec=645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:03.929838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:03.930238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:314 - starting polling. Elapsed:0.004 Oct 23 00:58:03.934431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:03.939122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:314 - port information retrieved. Elapsed:0.013 Oct 23 00:58:03.943968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', '3f16f421-4b09-4db8-bb39-036024ad1e08', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '503e26a7-75c9-489f-b284-76bdedd789ba', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '41fed497-9616-4065-81c5-649cbe8895a8', '36027a75-3b26-4728-a464-23e4dbba5d4a', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'4a7cd454-b41b-4353-a8da-dd92a4f996c1'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 00:58:03.944674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'mac_address': 'fa:16:3e:95:5b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 00:58:03.955960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 4a7cd454-b41b-4353-a8da-dd92a4f996c1 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 00:58:03.956524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 4a7cd454-b41b-4353-a8da-dd92a4f996c1 updated. Details: {'device': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'device_id': 'b43e72ec-e74f-4b3d-8313-064f4596d699', 'network_id': '570809ed-8943-4319-88c0-71a523125321', 'port_id': '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'mac_address': 'fa:16:3e:95:5b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f8f208d0-6d73-485f-ba6c-97c3f7122b3d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 23 00:58:03.957905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a7cd454-b4, col_values=(('tag', 11),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:03.958423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4a7cd454-b4, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:03.958919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4a7cd454-b4, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:03.959622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:58:03.960473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a7cd454-b4, col_values=(('other_config', {'net_uuid': '570809ed-8943-4319-88c0-71a523125321', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '363', 'tag': '11'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 00:58:03.961556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 00:58:03.964068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2b4e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:03.964586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:314 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 25 devices currently available. Time elapsed: 0.020 Oct 23 00:58:03.965110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 00:58:03.965550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 00:58:03.967042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 00:58:03.967372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 00:58:03.973255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 00:58:04.027247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26bb593-60d0-4765-bf82-a57cde1ce148]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 00:58:04.028405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:314 - agent port security group processed in 0.084 Oct 23 00:58:04.030049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 4a7cd454-b41b-4353-a8da-dd92a4f996c1 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 00:58:04.216312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['4a7cd454-b41b-4353-a8da-dd92a4f996c1'] and devices down [] completed. Oct 23 00:58:04.217348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:314 - ports processed. Elapsed:0.291 Oct 23 00:58:04.217964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:314 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.291 Oct 23 00:58:05.494708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 77da0074-6006-4aa3-98e5-60bc673f4b72 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:05.495375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (77da0074-6006-4aa3-98e5-60bc673f4b72), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:05.927588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:315 started Oct 23 00:58:05.930924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=1000000,duration_sec=647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:05.931503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:05.931836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:315 - starting polling. Elapsed:0.004 Oct 23 00:58:05.935016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:05.939696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:315 - port information retrieved. Elapsed:0.012 Oct 23 00:58:05.941603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:315 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 00:58:07.548412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 77da0074-6006-4aa3-98e5-60bc673f4b72 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:07.549815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (77da0074-6006-4aa3-98e5-60bc673f4b72), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:07.928680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:316 started Oct 23 00:58:07.932211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=3000000,duration_sec=649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:07.932914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:07.933505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:316 - starting polling. Elapsed:0.005 Oct 23 00:58:07.937184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:07.945115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:316 - port information retrieved. Elapsed:0.016 Oct 23 00:58:07.945773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:316 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 00:58:09.932884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:317 started Oct 23 00:58:09.934606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=4000000,duration_sec=651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:09.935868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:09.936403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:317 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:58:10.815376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:10Z,description='Default security group',id=42650120-c327-425f-b2cd-9a6917a78203,is_default=True,name='default',project_id='f371e22221164dff97ac7d5e48da4cef',revision_number=1,rules=[SecurityGroupRule(77651673-2f52-4216-bfd8-99af990d4973),SecurityGroupRule(8e0de1f7-50e9-40cf-82b9-0b8570f273d9),SecurityGroupRule(c026f476-3cf8-4ab9-9f2a-cb43748e4bb7),SecurityGroupRule(c4e85107-14e4-4e69-b62d-a8124ae92bd2)],shared=False,stateful=True,updated_at=2022-10-23T00:58:10Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:10.815930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (42650120-c327-425f-b2cd-9a6917a78203), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:10.816673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:10Z,description=,direction='ingress',ethertype='IPv4',id=77651673-2f52-4216-bfd8-99af990d4973,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f371e22221164dff97ac7d5e48da4cef',protocol=,remote_address_group_id=,remote_group_id=42650120-c327-425f-b2cd-9a6917a78203,remote_ip_prefix=,revision_number=0,security_group_id=42650120-c327-425f-b2cd-9a6917a78203,updated_at=2022-10-23T00:58:10Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:10.817165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (77651673-2f52-4216-bfd8-99af990d4973), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:10.817625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:10.818402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:10Z,description=,direction='egress',ethertype='IPv4',id=8e0de1f7-50e9-40cf-82b9-0b8570f273d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f371e22221164dff97ac7d5e48da4cef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42650120-c327-425f-b2cd-9a6917a78203,updated_at=2022-10-23T00:58:10Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:10.818870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8e0de1f7-50e9-40cf-82b9-0b8570f273d9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:10.819280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:10.820185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:10Z,description=,direction='egress',ethertype='IPv6',id=c026f476-3cf8-4ab9-9f2a-cb43748e4bb7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f371e22221164dff97ac7d5e48da4cef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42650120-c327-425f-b2cd-9a6917a78203,updated_at=2022-10-23T00:58:10Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:10.821270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c026f476-3cf8-4ab9-9f2a-cb43748e4bb7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:10.821700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:10.822509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:10Z,description=,direction='ingress',ethertype='IPv6',id=c4e85107-14e4-4e69-b62d-a8124ae92bd2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f371e22221164dff97ac7d5e48da4cef',protocol=,remote_address_group_id=,remote_group_id=42650120-c327-425f-b2cd-9a6917a78203,remote_ip_prefix=,revision_number=0,security_group_id=42650120-c327-425f-b2cd-9a6917a78203,updated_at=2022-10-23T00:58:10Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:10.823151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c4e85107-14e4-4e69-b62d-a8124ae92bd2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:10.823575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f9ed67bd-78d1-4c7b-a7c3-48a34d0d70dd admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:10.984581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Resource SecurityGroup deleted: 42650120-c327-425f-b2cd-9a6917a78203 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:10.985257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (42650120-c327-425f-b2cd-9a6917a78203), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:10.985528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('42650120-c327-425f-b2cd-9a6917a78203',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:11.006880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('42650120-c327-425f-b2cd-9a6917a78203',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:11.007743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Resource SecurityGroupRule deleted: 77651673-2f52-4216-bfd8-99af990d4973 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.008362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (77651673-2f52-4216-bfd8-99af990d4973), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.008929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:11.009505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Resource SecurityGroupRule deleted: 8e0de1f7-50e9-40cf-82b9-0b8570f273d9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.010050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8e0de1f7-50e9-40cf-82b9-0b8570f273d9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.010953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:11.011548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Resource SecurityGroupRule deleted: c026f476-3cf8-4ab9-9f2a-cb43748e4bb7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.012830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c026f476-3cf8-4ab9-9f2a-cb43748e4bb7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.013523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:11.014052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Resource SecurityGroupRule deleted: c4e85107-14e4-4e69-b62d-a8124ae92bd2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.014704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c4e85107-14e4-4e69-b62d-a8124ae92bd2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.015207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cda261c1-cb32-4269-995e-73d31600f1b4 admin admin] Security group rule updated ['42650120-c327-425f-b2cd-9a6917a78203'] Oct 23 00:58:11.514118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:11Z,description='Default security group',id=90c866ed-aca8-42ff-897a-169622edba20,is_default=True,name='default',project_id='3653de9dc3954c37a4b6ab41404fa14d',revision_number=1,rules=[SecurityGroupRule(3beca4c1-3c5a-4b55-884c-e03615492d92),SecurityGroupRule(66e8ff3a-d98d-46a4-926f-989f267797dd),SecurityGroupRule(95d98b35-993e-439b-891f-53f0d92bef44),SecurityGroupRule(eeaa9544-40bb-4669-8f72-8d4bd48d1095)],shared=False,stateful=True,updated_at=2022-10-23T00:58:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:11.514622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (90c866ed-aca8-42ff-897a-169622edba20), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.515408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:11Z,description=,direction='egress',ethertype='IPv6',id=3beca4c1-3c5a-4b55-884c-e03615492d92,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3653de9dc3954c37a4b6ab41404fa14d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=90c866ed-aca8-42ff-897a-169622edba20,updated_at=2022-10-23T00:58:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:11.516128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3beca4c1-3c5a-4b55-884c-e03615492d92), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.516659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.517565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:11Z,description=,direction='egress',ethertype='IPv4',id=66e8ff3a-d98d-46a4-926f-989f267797dd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3653de9dc3954c37a4b6ab41404fa14d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=90c866ed-aca8-42ff-897a-169622edba20,updated_at=2022-10-23T00:58:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:11.518117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (66e8ff3a-d98d-46a4-926f-989f267797dd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.518622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.519496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:11Z,description=,direction='ingress',ethertype='IPv4',id=95d98b35-993e-439b-891f-53f0d92bef44,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3653de9dc3954c37a4b6ab41404fa14d',protocol=,remote_address_group_id=,remote_group_id=90c866ed-aca8-42ff-897a-169622edba20,remote_ip_prefix=,revision_number=0,security_group_id=90c866ed-aca8-42ff-897a-169622edba20,updated_at=2022-10-23T00:58:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:11.520119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (95d98b35-993e-439b-891f-53f0d92bef44), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.520636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.522861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:11Z,description=,direction='ingress',ethertype='IPv6',id=eeaa9544-40bb-4669-8f72-8d4bd48d1095,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3653de9dc3954c37a4b6ab41404fa14d',protocol=,remote_address_group_id=,remote_group_id=90c866ed-aca8-42ff-897a-169622edba20,remote_ip_prefix=,revision_number=0,security_group_id=90c866ed-aca8-42ff-897a-169622edba20,updated_at=2022-10-23T00:58:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:11.523635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (eeaa9544-40bb-4669-8f72-8d4bd48d1095), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.525723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-45b71948-a356-4251-8db6-6ab8092e68c6 admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.671084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Resource SecurityGroup deleted: 90c866ed-aca8-42ff-897a-169622edba20 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.671488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (90c866ed-aca8-42ff-897a-169622edba20), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.671962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('90c866ed-aca8-42ff-897a-169622edba20',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:11.710985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('90c866ed-aca8-42ff-897a-169622edba20',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:11.711975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Resource SecurityGroupRule deleted: 3beca4c1-3c5a-4b55-884c-e03615492d92 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.712760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3beca4c1-3c5a-4b55-884c-e03615492d92), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.713499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.714342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Resource SecurityGroupRule deleted: 66e8ff3a-d98d-46a4-926f-989f267797dd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.715116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (66e8ff3a-d98d-46a4-926f-989f267797dd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.716082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.716923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Resource SecurityGroupRule deleted: 95d98b35-993e-439b-891f-53f0d92bef44 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.717432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (95d98b35-993e-439b-891f-53f0d92bef44), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.717942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.718777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Resource SecurityGroupRule deleted: eeaa9544-40bb-4669-8f72-8d4bd48d1095 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:11.719291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (eeaa9544-40bb-4669-8f72-8d4bd48d1095), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:11.719838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-37f81e8e-1c26-4187-8d92-3f9e5f89bb0a admin admin] Security group rule updated ['90c866ed-aca8-42ff-897a-169622edba20'] Oct 23 00:58:11.931639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:318 started Oct 23 00:58:11.934610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=5000000,duration_sec=653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:11.935398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:11.936089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:318 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:58:13.466240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02b9dda7-74de-4498-a8cc-a2a058dea562 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:58:12Z,data_plane_status=None,description='',device_id='66d3ff7f-a7b9-4b82-a87a-7c732191a284',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=03b8c8cc-3573-4004-a318-cc6ea8e45066,mac_address=fa:16:3e:8f:64:eb,name='',network_id=a82fecef-3e22-41fa-8192-25cadd682e03,numa_affinity_policy=,project_id='2b5536e4b945479e8972cb5a95f60324',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(03b8c8cc-3573-4004-a318-cc6ea8e45066),security_group_ids=set([ef20917c-8dad-4b49-8e2b-5fc4aa0568d5]),status='DOWN',updated_at=2022-10-23T00:58:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:13.466763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02b9dda7-74de-4498-a8cc-a2a058dea562 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:13.467071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-02b9dda7-74de-4498-a8cc-a2a058dea562 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group member updated {'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'} Oct 23 00:58:13.932887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:319 started Oct 23 00:58:13.939313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=6000000,duration_sec=655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:13.940159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:13.940572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:319 - starting polling. Elapsed:0.008 Oct 23 00:58:13.946729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:13.954638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:319 - port information retrieved. Elapsed:0.022 Oct 23 00:58:13.955069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:319 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Oct 23 00:58:15.443012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:15.443828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:15.933619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:320 started Oct 23 00:58:15.937190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=7000000,duration_sec=657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:15.938159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:15.938500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:320 - starting polling. Elapsed:0.005 Oct 23 00:58:15.941729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:15.946396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:320 - port information retrieved. Elapsed:0.013 Oct 23 00:58:15.946941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:320 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 00:58:17.464369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:17.465044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:17.934089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:321 started Oct 23 00:58:17.937474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=7000000,duration_sec=659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:17.938230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:17.938600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:321 - starting polling. Elapsed:0.005 Oct 23 00:58:17.942031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:17.950868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:321 - port information retrieved. Elapsed:0.017 Oct 23 00:58:17.951263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:321 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 00:58:19.934961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:322 started Oct 23 00:58:19.938628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=9000000,duration_sec=661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:19.939986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:19.940348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:322 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:58:21.378729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:21Z,description='Default security group',id=daabea36-f1bc-4f0a-a013-0080047b0da4,is_default=True,name='default',project_id='9bf938d765024bad9d9aeda8fe5d4269',revision_number=1,rules=[SecurityGroupRule(8c875a9f-3f27-4c9a-a3dc-a518b744d6c9),SecurityGroupRule(b17c1d50-a09c-4cc4-93a8-f8751905ceee),SecurityGroupRule(bbd35bf1-9ac8-47c2-883e-a0a328a9c967),SecurityGroupRule(e43948ac-40e5-4641-9a3b-8f72b914b051)],shared=False,stateful=True,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:21.379920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (daabea36-f1bc-4f0a-a013-0080047b0da4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.381094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='egress',ethertype='IPv6',id=8c875a9f-3f27-4c9a-a3dc-a518b744d6c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9bf938d765024bad9d9aeda8fe5d4269',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=daabea36-f1bc-4f0a-a013-0080047b0da4,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:21.381662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8c875a9f-3f27-4c9a-a3dc-a518b744d6c9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.382299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.383179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='ingress',ethertype='IPv4',id=b17c1d50-a09c-4cc4-93a8-f8751905ceee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9bf938d765024bad9d9aeda8fe5d4269',protocol=,remote_address_group_id=,remote_group_id=daabea36-f1bc-4f0a-a013-0080047b0da4,remote_ip_prefix=,revision_number=0,security_group_id=daabea36-f1bc-4f0a-a013-0080047b0da4,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:21.383981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b17c1d50-a09c-4cc4-93a8-f8751905ceee), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.384551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.385804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='ingress',ethertype='IPv6',id=bbd35bf1-9ac8-47c2-883e-a0a328a9c967,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9bf938d765024bad9d9aeda8fe5d4269',protocol=,remote_address_group_id=,remote_group_id=daabea36-f1bc-4f0a-a013-0080047b0da4,remote_ip_prefix=,revision_number=0,security_group_id=daabea36-f1bc-4f0a-a013-0080047b0da4,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:21.386391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (bbd35bf1-9ac8-47c2-883e-a0a328a9c967), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.386965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.387688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='egress',ethertype='IPv4',id=e43948ac-40e5-4641-9a3b-8f72b914b051,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9bf938d765024bad9d9aeda8fe5d4269',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=daabea36-f1bc-4f0a-a013-0080047b0da4,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:21.388154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e43948ac-40e5-4641-9a3b-8f72b914b051), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.388559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7aaa4254-0360-4acb-ab1c-de23d75c61fa admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.532262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Resource SecurityGroup deleted: daabea36-f1bc-4f0a-a013-0080047b0da4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:21.532696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (daabea36-f1bc-4f0a-a013-0080047b0da4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.533188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('daabea36-f1bc-4f0a-a013-0080047b0da4',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:21.551652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('daabea36-f1bc-4f0a-a013-0080047b0da4',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:21.552247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Resource SecurityGroupRule deleted: 8c875a9f-3f27-4c9a-a3dc-a518b744d6c9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:21.552770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8c875a9f-3f27-4c9a-a3dc-a518b744d6c9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.553146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.553561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Resource SecurityGroupRule deleted: b17c1d50-a09c-4cc4-93a8-f8751905ceee {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:21.554083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b17c1d50-a09c-4cc4-93a8-f8751905ceee), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.554388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.554925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Resource SecurityGroupRule deleted: bbd35bf1-9ac8-47c2-883e-a0a328a9c967 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:21.555269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (bbd35bf1-9ac8-47c2-883e-a0a328a9c967), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.555838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.556490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Resource SecurityGroupRule deleted: e43948ac-40e5-4641-9a3b-8f72b914b051 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:21.556893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e43948ac-40e5-4641-9a3b-8f72b914b051), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:21.557213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3621ba70-9894-4545-88c5-76370603adfd admin admin] Security group rule updated ['daabea36-f1bc-4f0a-a013-0080047b0da4'] Oct 23 00:58:21.936969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:323 started Oct 23 00:58:21.940003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=11000000,duration_sec=663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:21.941385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:21.941692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:323 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:58:22.011649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:21Z,description='Default security group',id=cc382ea0-36de-4311-b17b-fb52832f4691,is_default=True,name='default',project_id='9f5dfe40c4ea4827bf922cd79f13a637',revision_number=1,rules=[SecurityGroupRule(2080b4ce-12e9-4926-a304-85f2fda44d16),SecurityGroupRule(47709219-ab46-4a79-b4bd-a0b266a5bb4f),SecurityGroupRule(4cc02575-3823-4172-876d-3de49cf3614e),SecurityGroupRule(ff473311-dcd9-403b-af64-b3938bcbbd15)],shared=False,stateful=True,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.012027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (cc382ea0-36de-4311-b17b-fb52832f4691), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.012638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='egress',ethertype='IPv6',id=2080b4ce-12e9-4926-a304-85f2fda44d16,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f5dfe40c4ea4827bf922cd79f13a637',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cc382ea0-36de-4311-b17b-fb52832f4691,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.013026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2080b4ce-12e9-4926-a304-85f2fda44d16), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.013741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.014015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='ingress',ethertype='IPv6',id=47709219-ab46-4a79-b4bd-a0b266a5bb4f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f5dfe40c4ea4827bf922cd79f13a637',protocol=,remote_address_group_id=,remote_group_id=cc382ea0-36de-4311-b17b-fb52832f4691,remote_ip_prefix=,revision_number=0,security_group_id=cc382ea0-36de-4311-b17b-fb52832f4691,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.014390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (47709219-ab46-4a79-b4bd-a0b266a5bb4f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.014709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.015369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='ingress',ethertype='IPv4',id=4cc02575-3823-4172-876d-3de49cf3614e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f5dfe40c4ea4827bf922cd79f13a637',protocol=,remote_address_group_id=,remote_group_id=cc382ea0-36de-4311-b17b-fb52832f4691,remote_ip_prefix=,revision_number=0,security_group_id=cc382ea0-36de-4311-b17b-fb52832f4691,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.015696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4cc02575-3823-4172-876d-3de49cf3614e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.016389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.016674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:21Z,description=,direction='egress',ethertype='IPv4',id=ff473311-dcd9-403b-af64-b3938bcbbd15,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9f5dfe40c4ea4827bf922cd79f13a637',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cc382ea0-36de-4311-b17b-fb52832f4691,updated_at=2022-10-23T00:58:21Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.017057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ff473311-dcd9-403b-af64-b3938bcbbd15), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.017372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a8cd9448-1472-4e17-b9aa-c433d0251f6d admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.163827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Resource SecurityGroup deleted: cc382ea0-36de-4311-b17b-fb52832f4691 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.164218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (cc382ea0-36de-4311-b17b-fb52832f4691), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.164676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cc382ea0-36de-4311-b17b-fb52832f4691',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:22.178969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cc382ea0-36de-4311-b17b-fb52832f4691',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:22.179483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Resource SecurityGroupRule deleted: 2080b4ce-12e9-4926-a304-85f2fda44d16 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.179912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2080b4ce-12e9-4926-a304-85f2fda44d16), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.180250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.180633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Resource SecurityGroupRule deleted: 47709219-ab46-4a79-b4bd-a0b266a5bb4f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.181538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (47709219-ab46-4a79-b4bd-a0b266a5bb4f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.181945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.182827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Resource SecurityGroupRule deleted: 4cc02575-3823-4172-876d-3de49cf3614e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.183193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4cc02575-3823-4172-876d-3de49cf3614e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.185982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.186443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Resource SecurityGroupRule deleted: ff473311-dcd9-403b-af64-b3938bcbbd15 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.186859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ff473311-dcd9-403b-af64-b3938bcbbd15), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.187264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a3aedfb-d799-4293-afb8-07bafbf8b9a5 admin admin] Security group rule updated ['cc382ea0-36de-4311-b17b-fb52832f4691'] Oct 23 00:58:22.703363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:22Z,description='Default security group',id=6694c6ca-456d-42e0-b8a0-b07fe63b2c56,is_default=True,name='default',project_id='3b1a16bdad5d4202aadb069e34496f4d',revision_number=1,rules=[SecurityGroupRule(1cb074bc-375a-4913-af90-eca0b399d240),SecurityGroupRule(3ef3bfd4-be59-4fe0-b3c0-0a3addd316d4),SecurityGroupRule(56c16fe9-e454-4995-af75-a748bd0a92bc),SecurityGroupRule(8d5739c6-71c9-45ff-ac08-0a748b90c2f6)],shared=False,stateful=True,updated_at=2022-10-23T00:58:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.704380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (6694c6ca-456d-42e0-b8a0-b07fe63b2c56), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.705251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:22Z,description=,direction='egress',ethertype='IPv6',id=1cb074bc-375a-4913-af90-eca0b399d240,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b1a16bdad5d4202aadb069e34496f4d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6694c6ca-456d-42e0-b8a0-b07fe63b2c56,updated_at=2022-10-23T00:58:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.705872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1cb074bc-375a-4913-af90-eca0b399d240), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.706346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:22.707200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:22Z,description=,direction='ingress',ethertype='IPv4',id=3ef3bfd4-be59-4fe0-b3c0-0a3addd316d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b1a16bdad5d4202aadb069e34496f4d',protocol=,remote_address_group_id=,remote_group_id=6694c6ca-456d-42e0-b8a0-b07fe63b2c56,remote_ip_prefix=,revision_number=0,security_group_id=6694c6ca-456d-42e0-b8a0-b07fe63b2c56,updated_at=2022-10-23T00:58:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.707665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3ef3bfd4-be59-4fe0-b3c0-0a3addd316d4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.708138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:22.708971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:22Z,description=,direction='ingress',ethertype='IPv6',id=56c16fe9-e454-4995-af75-a748bd0a92bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b1a16bdad5d4202aadb069e34496f4d',protocol=,remote_address_group_id=,remote_group_id=6694c6ca-456d-42e0-b8a0-b07fe63b2c56,remote_ip_prefix=,revision_number=0,security_group_id=6694c6ca-456d-42e0-b8a0-b07fe63b2c56,updated_at=2022-10-23T00:58:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.709493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (56c16fe9-e454-4995-af75-a748bd0a92bc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.709953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:22.710736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:22Z,description=,direction='egress',ethertype='IPv4',id=8d5739c6-71c9-45ff-ac08-0a748b90c2f6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b1a16bdad5d4202aadb069e34496f4d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6694c6ca-456d-42e0-b8a0-b07fe63b2c56,updated_at=2022-10-23T00:58:22Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:22.711230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8d5739c6-71c9-45ff-ac08-0a748b90c2f6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.711832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5ab265df-456f-4397-85e7-b3e475891f24 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:22.843625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Resource SecurityGroup deleted: 6694c6ca-456d-42e0-b8a0-b07fe63b2c56 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.844138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (6694c6ca-456d-42e0-b8a0-b07fe63b2c56), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.844449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6694c6ca-456d-42e0-b8a0-b07fe63b2c56',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:58:22.859283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6694c6ca-456d-42e0-b8a0-b07fe63b2c56',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:58:22.860625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Resource SecurityGroupRule deleted: 1cb074bc-375a-4913-af90-eca0b399d240 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.861207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1cb074bc-375a-4913-af90-eca0b399d240), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.861686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:22.862299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Resource SecurityGroupRule deleted: 3ef3bfd4-be59-4fe0-b3c0-0a3addd316d4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.863019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3ef3bfd4-be59-4fe0-b3c0-0a3addd316d4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.863502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:22.864210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Resource SecurityGroupRule deleted: 56c16fe9-e454-4995-af75-a748bd0a92bc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.864731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (56c16fe9-e454-4995-af75-a748bd0a92bc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.865215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:22.865723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Resource SecurityGroupRule deleted: 8d5739c6-71c9-45ff-ac08-0a748b90c2f6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:22.866205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8d5739c6-71c9-45ff-ac08-0a748b90c2f6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:22.866662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-72b663d5-735e-4394-8216-31f24303ebe4 admin admin] Security group rule updated ['6694c6ca-456d-42e0-b8a0-b07fe63b2c56'] Oct 23 00:58:23.185533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a553e6d3-34e3-447a-9bc3-f63d769f5cd3 service neutron] Resource Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=03b8c8cc-3573-4004-a318-cc6ea8e45066,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=03b8c8cc-3573-4004-a318-cc6ea8e45066,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:23.185908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a553e6d3-34e3-447a-9bc3-f63d769f5cd3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.495006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a553e6d3-34e3-447a-9bc3-f63d769f5cd3 service neutron] Resource Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=03b8c8cc-3573-4004-a318-cc6ea8e45066,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=03b8c8cc-3573-4004-a318-cc6ea8e45066,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=03b8c8cc-3573-4004-a318-cc6ea8e45066,segment=NetworkSegment(cddd1db6-cf69-4403-969b-c4a8db3f5024),segment_id=cddd1db6-cf69-4403-969b-c4a8db3f5024)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:23.495469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a553e6d3-34e3-447a-9bc3-f63d769f5cd3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.852065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:23Z,description='Default security group',id=aee26348-8e69-40a4-ac27-4b922e21afd6,is_default=True,name='default',project_id='b5384f8ed0fa4c7695758da237326753',revision_number=1,rules=[SecurityGroupRule(1f8880ae-b590-41ac-9848-b7e603d6dc5c),SecurityGroupRule(24d9bbb2-7260-44b7-8743-a3a52ce6aa33),SecurityGroupRule(49188a72-d349-4514-aae6-81fa40ad5dd3),SecurityGroupRule(49bc0d22-3150-4c53-b983-5ac04dad796b)],shared=False,stateful=True,updated_at=2022-10-23T00:58:23Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:23.853314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (aee26348-8e69-40a4-ac27-4b922e21afd6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.854098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:23Z,description=,direction='ingress',ethertype='IPv6',id=1f8880ae-b590-41ac-9848-b7e603d6dc5c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5384f8ed0fa4c7695758da237326753',protocol=,remote_address_group_id=,remote_group_id=aee26348-8e69-40a4-ac27-4b922e21afd6,remote_ip_prefix=,revision_number=0,security_group_id=aee26348-8e69-40a4-ac27-4b922e21afd6,updated_at=2022-10-23T00:58:23Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:23.854631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1f8880ae-b590-41ac-9848-b7e603d6dc5c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.854962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:58:23.855665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:23Z,description=,direction='egress',ethertype='IPv6',id=24d9bbb2-7260-44b7-8743-a3a52ce6aa33,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5384f8ed0fa4c7695758da237326753',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aee26348-8e69-40a4-ac27-4b922e21afd6,updated_at=2022-10-23T00:58:23Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:23.856010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (24d9bbb2-7260-44b7-8743-a3a52ce6aa33), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.856307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:58:23.856962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:23Z,description=,direction='egress',ethertype='IPv4',id=49188a72-d349-4514-aae6-81fa40ad5dd3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5384f8ed0fa4c7695758da237326753',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aee26348-8e69-40a4-ac27-4b922e21afd6,updated_at=2022-10-23T00:58:23Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:23.857601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (49188a72-d349-4514-aae6-81fa40ad5dd3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.858132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:58:23.859238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:23Z,description=,direction='ingress',ethertype='IPv4',id=49bc0d22-3150-4c53-b983-5ac04dad796b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5384f8ed0fa4c7695758da237326753',protocol=,remote_address_group_id=,remote_group_id=aee26348-8e69-40a4-ac27-4b922e21afd6,remote_ip_prefix=,revision_number=0,security_group_id=aee26348-8e69-40a4-ac27-4b922e21afd6,updated_at=2022-10-23T00:58:23Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:23.859754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (49bc0d22-3150-4c53-b983-5ac04dad796b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.860216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:58:23.937371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:324 started Oct 23 00:58:23.939952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=11000000,duration_sec=665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:23.940875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:23.941100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:324 - starting polling. Elapsed:0.004 Oct 23 00:58:23.944239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:23.948598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:324 - port information retrieved. Elapsed:0.011 Oct 23 00:58:23.948963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:324 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:58:24.016968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T00:58:23Z,description='',dns_domain=None,id=706576df-d255-452e-b7ba-460fee4fb9d4,mtu=1500,name='tempest-VolumesActionsTest-192332278-network',project_id='b5384f8ed0fa4c7695758da237326753',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(706576df-d255-452e-b7ba-460fee4fb9d4),segments=[NetworkSegment(5d321273-3f83-40d4-be02-80695052ceb8)],shared=False,status='ACTIVE',updated_at=2022-10-23T00:58:23Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:24.017592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (706576df-d255-452e-b7ba-460fee4fb9d4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-c36c26d4-3de0-4878-b4c8-8adc510e0cfa admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 706576df-d255-452e-b7ba-460fee4fb9d4 with segmentation id not found. Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 00:58:24.234510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 00:58:24.235593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 00:58:24.235593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 00:58:24.235593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 00:58:24.235593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 706576df-d255-452e-b7ba-460fee4fb9d4 with segmentation id not found. Oct 23 00:58:24.235593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 00:58:24.314007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2e4778cc-01c1-4d5e-8e4e-4cecb8392592 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(a1c5e6e1-8163-405a-b51e-e0ae88893882)],cidr=172.20.0.0/28,created_at=2022-10-23T00:58:24Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=5a084bd4-dc2a-4656-9023-88a6c081dfcb,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-192332278-subnet',network_id=706576df-d255-452e-b7ba-460fee4fb9d4,project_id='b5384f8ed0fa4c7695758da237326753',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T00:58:24Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:24.314377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2e4778cc-01c1-4d5e-8e4e-4cecb8392592 admin admin] Publish callbacks [] for Subnet (5a084bd4-dc2a-4656-9023-88a6c081dfcb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:25.938852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:325 started Oct 23 00:58:25.941420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=12000000,duration_sec=667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:25.941994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:25.942732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:325 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:58:27.652146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:27.654030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:27.939400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:326 started Oct 23 00:58:27.942169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=13000000,duration_sec=669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:27.942771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:27.943116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:326 - starting polling. Elapsed:0.004 Oct 23 00:58:27.946292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:27.950648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:326 - port information retrieved. Elapsed:0.011 Oct 23 00:58:27.950989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:326 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:58:29.607605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:29.608322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:29.939938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:327 started Oct 23 00:58:29.947794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=18000000,duration_sec=671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:29.948588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:29.948966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:327 - starting polling. Elapsed:0.009 Oct 23 00:58:29.952172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:29.958129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:327 - port information retrieved. Elapsed:0.018 Oct 23 00:58:29.958641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:327 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Oct 23 00:58:30.045366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-be679a8a-de9d-4e19-960d-7c02a1084ba8 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:58:29Z,data_plane_status=None,description='',device_id='7015e66d-3b14-4b79-a5ff-1b031523252b',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=19512650-9bca-4907-b617-1c0c66b0d695,mac_address=fa:16:3e:5c:02:f5,name='',network_id=706576df-d255-452e-b7ba-460fee4fb9d4,numa_affinity_policy=,project_id='b5384f8ed0fa4c7695758da237326753',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(19512650-9bca-4907-b617-1c0c66b0d695),security_group_ids=set([aee26348-8e69-40a4-ac27-4b922e21afd6]),status='DOWN',updated_at=2022-10-23T00:58:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:30.045892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-be679a8a-de9d-4e19-960d-7c02a1084ba8 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (19512650-9bca-4907-b617-1c0c66b0d695), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:30.047683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-be679a8a-de9d-4e19-960d-7c02a1084ba8 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Security group member updated {'aee26348-8e69-40a4-ac27-4b922e21afd6'} Oct 23 00:58:31.078032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-103e7a07-4948-4ae8-b631-0539400de4ad service neutron] Resource Port 19512650-9bca-4907-b617-1c0c66b0d695 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=19512650-9bca-4907-b617-1c0c66b0d695,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=19512650-9bca-4907-b617-1c0c66b0d695,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:31.079531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-103e7a07-4948-4ae8-b631-0539400de4ad service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (19512650-9bca-4907-b617-1c0c66b0d695), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:31.459076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-103e7a07-4948-4ae8-b631-0539400de4ad service neutron] Resource Port 19512650-9bca-4907-b617-1c0c66b0d695 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=19512650-9bca-4907-b617-1c0c66b0d695,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=19512650-9bca-4907-b617-1c0c66b0d695,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=19512650-9bca-4907-b617-1c0c66b0d695,segment=NetworkSegment(5d321273-3f83-40d4-be02-80695052ceb8),segment_id=5d321273-3f83-40d4-be02-80695052ceb8)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:31.459536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-103e7a07-4948-4ae8-b631-0539400de4ad service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (19512650-9bca-4907-b617-1c0c66b0d695), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:31.941333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:328 started Oct 23 00:58:31.946615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=15000000,duration_sec=673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:31.947487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:31.948183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:328 - starting polling. Elapsed:0.007 Oct 23 00:58:31.952110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:31.957728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:328 - port information retrieved. Elapsed:0.017 Oct 23 00:58:31.958413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:328 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 00:58:33.942107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:329 started Oct 23 00:58:33.945234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=15000000,duration_sec=675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:33.946054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:33.946596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:329 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:58:35.666040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 19512650-9bca-4907-b617-1c0c66b0d695 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:35.667259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (19512650-9bca-4907-b617-1c0c66b0d695), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:35.943477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:330 started Oct 23 00:58:35.946735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=17000000,duration_sec=677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:35.947498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:35.947911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:330 - starting polling. Elapsed:0.005 Oct 23 00:58:35.951475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:35.956479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:330 - port information retrieved. Elapsed:0.013 Oct 23 00:58:35.959620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:330 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 23 00:58:37.582253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 19512650-9bca-4907-b617-1c0c66b0d695 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:37.582908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (19512650-9bca-4907-b617-1c0c66b0d695), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:37.945043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:331 started Oct 23 00:58:37.947756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=19000000,duration_sec=679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:37.948381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:37.948697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:331 - starting polling. Elapsed:0.004 Oct 23 00:58:37.951981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:37.957008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:331 - port information retrieved. Elapsed:0.012 Oct 23 00:58:37.957356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:331 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 00:58:39.946206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:332 started Oct 23 00:58:39.949728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=20000000,duration_sec=681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:39.950535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:39.951024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:332 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:58:41.521135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:41.521791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:41.947025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:333 started Oct 23 00:58:41.950391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=21000000,duration_sec=683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:41.951000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:41.951341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:333 - starting polling. Elapsed:0.005 Oct 23 00:58:41.954496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:41.958947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:333 - port information retrieved. Elapsed:0.012 Oct 23 00:58:41.959274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:333 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:58:43.948764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:334 started Oct 23 00:58:43.952206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=22000000,duration_sec=685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:43.953050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:43.953576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:334 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:58:44.884076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfbdb173-220c-4238-a1f9-72ae632652ed tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Resource Port deleted: 19512650-9bca-4907-b617-1c0c66b0d695 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:58:44.884543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfbdb173-220c-4238-a1f9-72ae632652ed tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (19512650-9bca-4907-b617-1c0c66b0d695), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:44.885074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfbdb173-220c-4238-a1f9-72ae632652ed tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Security group member updated {'aee26348-8e69-40a4-ac27-4b922e21afd6'} Oct 23 00:58:45.863938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f18c312-536c-4b06-be00-f3a27f2848ec tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:58:45Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5e5d53f2-8969-4a48-aafc-fdbdd3b240da,mac_address=fa:16:3e:ba:4d:f1,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5e5d53f2-8969-4a48-aafc-fdbdd3b240da),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T00:58:45Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:45.864921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f18c312-536c-4b06-be00-f3a27f2848ec tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (5e5d53f2-8969-4a48-aafc-fdbdd3b240da), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:45.949847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:335 started Oct 23 00:58:45.952966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=24000000,duration_sec=687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:45.953589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:45.953936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:335 - starting polling. Elapsed:0.004 Oct 23 00:58:45.957183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:45.959658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 19512650-9bca-4907-b617-1c0c66b0d695 not present in bridge br-int Oct 23 00:58:45.960030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 00:58:45.960281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['19512650-9bca-4907-b617-1c0c66b0d695'] Oct 23 00:58:45.960808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 19512650-9bca-4907-b617-1c0c66b0d695 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 00:58:45.965342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:335 - port information retrieved. Elapsed:0.016 Oct 23 00:58:45.965872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:335 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 23 00:58:46.556121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f18c312-536c-4b06-be00-f3a27f2848ec tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource Port 5e5d53f2-8969-4a48-aafc-fdbdd3b240da updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '5f4efb14-f169-4f55-867f-640f5eee0093'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:46.556501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f18c312-536c-4b06-be00-f3a27f2848ec tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (5e5d53f2-8969-4a48-aafc-fdbdd3b240da), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:47.310371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:58:47Z,description='tempest-secgroup-smoke-1755196010 description',id=ec73b002-330e-47cc-a826-68d3bc97dba7,is_default=False,name='tempest-secgroup-smoke-1755196010',project_id='2b5536e4b945479e8972cb5a95f60324',revision_number=1,rules=[SecurityGroupRule(6a3a6503-38df-4768-abbf-0363e2f78bf8),SecurityGroupRule(6fe5ce8d-ec0f-4fa2-800d-a927760f3502)],shared=False,stateful=True,updated_at=2022-10-23T00:58:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:47.311219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (ec73b002-330e-47cc-a826-68d3bc97dba7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:47.311475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:47Z,description=,direction='egress',ethertype='IPv6',id=6a3a6503-38df-4768-abbf-0363e2f78bf8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:47.311896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6a3a6503-38df-4768-abbf-0363e2f78bf8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:47.312386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:47.313144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:47Z,description=,direction='egress',ethertype='IPv4',id=6fe5ce8d-ec0f-4fa2-800d-a927760f3502,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:47.313588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6fe5ce8d-ec0f-4fa2-800d-a927760f3502), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:47.313886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3bfb5712-fc7a-4dee-97e4-12dd3191530e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:47.500820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f3307e00-3cc8-475f-b44f-30fb6eaa2f12 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:47Z,description='',direction='ingress',ethertype='IPv4',id=a482dd5d-6fe8-456d-adbe-a8c53e1ccec3,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='2b5536e4b945479e8972cb5a95f60324',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:47.501529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f3307e00-3cc8-475f-b44f-30fb6eaa2f12 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a482dd5d-6fe8-456d-adbe-a8c53e1ccec3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:47.502101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f3307e00-3cc8-475f-b44f-30fb6eaa2f12 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:47.809362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e3ff166e-d4b2-4862-9e4e-ce0cef1cefc9 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:47Z,description='',direction='egress',ethertype='IPv4',id=c163b1ea-f6c7-4c2a-b8d1-7ff520a28e0b,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='2b5536e4b945479e8972cb5a95f60324',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:47.809997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e3ff166e-d4b2-4862-9e4e-ce0cef1cefc9 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c163b1ea-f6c7-4c2a-b8d1-7ff520a28e0b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:47.810396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e3ff166e-d4b2-4862-9e4e-ce0cef1cefc9 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:47.950261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:336 started Oct 23 00:58:47.953266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=24000000,duration_sec=689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:47.953992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:47.954744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:336 - starting polling. Elapsed:0.004 Oct 23 00:58:47.959101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:47.970727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:336 - port information retrieved. Elapsed:0.020 Oct 23 00:58:47.972487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:336 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Oct 23 00:58:48.062515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-46ba6502-1df8-4d4a-a278-7516bee64af9 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:48Z,description='',direction='ingress',ethertype='IPv4',id=88874361-23cc-4f91-bf53-df4c67549e21,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:48.064314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-46ba6502-1df8-4d4a-a278-7516bee64af9 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (88874361-23cc-4f91-bf53-df4c67549e21), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:48.064703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-46ba6502-1df8-4d4a-a278-7516bee64af9 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:48.548846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da8db441-0695-4864-9c0f-21ffe695accd tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:48Z,description='',direction='egress',ethertype='IPv4',id=6ff16eec-bbf1-4ecb-82c9-de251207f140,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:48.550063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-da8db441-0695-4864-9c0f-21ffe695accd tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6ff16eec-bbf1-4ecb-82c9-de251207f140), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:48.550423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-da8db441-0695-4864-9c0f-21ffe695accd tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:48.715595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1c4ebad7-af27-4ab2-9b95-1250b33aff40 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:48Z,description='',direction='ingress',ethertype='IPv6',id=986c172c-fdc1-4b08-92c6-13758aef3038,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:48.716706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1c4ebad7-af27-4ab2-9b95-1250b33aff40 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (986c172c-fdc1-4b08-92c6-13758aef3038), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:48.717409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1c4ebad7-af27-4ab2-9b95-1250b33aff40 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:48.855852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-70b20f45-0550-445d-a3a4-f0bd21ad1019 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:58:48Z,description='',direction='egress',ethertype='IPv6',id=7aa2f5e2-4393-4db5-9c05-73a32f10e9d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b5536e4b945479e8972cb5a95f60324',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ec73b002-330e-47cc-a826-68d3bc97dba7,updated_at=2022-10-23T00:58:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:58:48.856267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-70b20f45-0550-445d-a3a4-f0bd21ad1019 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7aa2f5e2-4393-4db5-9c05-73a32f10e9d1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:48.856686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-70b20f45-0550-445d-a3a4-f0bd21ad1019 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 00:58:49.794575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6b23ef04-5ec8-4ed2-aa3c-5a7aaec19e16 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 updated (revision_number 5->6). Old fields: {'security_group_ids': CoercedSet({'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'})} New fields: {'security_group_ids': CoercedSet({'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5', 'ec73b002-330e-47cc-a826-68d3bc97dba7'})} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:58:49.795276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6b23ef04-5ec8-4ed2-aa3c-5a7aaec19e16 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:49.795605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6b23ef04-5ec8-4ed2-aa3c-5a7aaec19e16 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group member updated {'ec73b002-330e-47cc-a826-68d3bc97dba7', 'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'} Oct 23 00:58:49.954093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:337 started Oct 23 00:58:49.956838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=28000000,duration_sec=691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:49.957740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:49.959971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:337 - starting polling. Elapsed:0.006 Oct 23 00:58:49.976750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:58:49.976750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:337 - port information retrieved. Elapsed:0.018 Oct 23 00:58:49.976750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:337 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 23 00:58:51.955559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:338 started Oct 23 00:58:51.958311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=29000000,duration_sec=693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:51.958933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:51.959281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:338 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:58:53.956225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:339 started Oct 23 00:58:53.959302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=30000000,duration_sec=695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:53.960204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:53.960683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:339 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:58:55.957672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:340 started Oct 23 00:58:55.963048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=34000000,duration_sec=697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:55.963736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:55.964142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:340 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:58:57.959342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:341 started Oct 23 00:58:57.965000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=34000000,duration_sec=699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:57.966026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:57.966854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:341 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 00:58:59.960629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:342 started Oct 23 00:58:59.963297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=34000000,duration_sec=701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:58:59.963962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:58:59.964324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:342 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:00.079973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-62955e7c-094e-46e1-9c78-1ba082bee513 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T00:58:59Z,data_plane_status=None,description='',device_id='7157e296-84b2-4c04-bdb6-168df86b3403',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=18c0ff33-2d95-418b-abd3-b89da402d2c4,mac_address=fa:16:3e:a1:32:09,name='',network_id=706576df-d255-452e-b7ba-460fee4fb9d4,numa_affinity_policy=,project_id='b5384f8ed0fa4c7695758da237326753',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(18c0ff33-2d95-418b-abd3-b89da402d2c4),security_group_ids=set([aee26348-8e69-40a4-ac27-4b922e21afd6]),status='DOWN',updated_at=2022-10-23T00:58:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:59:00.080373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-62955e7c-094e-46e1-9c78-1ba082bee513 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (18c0ff33-2d95-418b-abd3-b89da402d2c4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:00.080862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-62955e7c-094e-46e1-9c78-1ba082bee513 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Security group member updated {'aee26348-8e69-40a4-ac27-4b922e21afd6'} Oct 23 00:59:01.028624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6efbf2c3-cdd5-43c1-9e74-1cd4d911f984 service neutron] Resource Port 18c0ff33-2d95-418b-abd3-b89da402d2c4 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=18c0ff33-2d95-418b-abd3-b89da402d2c4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=18c0ff33-2d95-418b-abd3-b89da402d2c4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:59:01.029361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6efbf2c3-cdd5-43c1-9e74-1cd4d911f984 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (18c0ff33-2d95-418b-abd3-b89da402d2c4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:01.554399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6efbf2c3-cdd5-43c1-9e74-1cd4d911f984 service neutron] Resource Port 18c0ff33-2d95-418b-abd3-b89da402d2c4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=18c0ff33-2d95-418b-abd3-b89da402d2c4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=18c0ff33-2d95-418b-abd3-b89da402d2c4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=18c0ff33-2d95-418b-abd3-b89da402d2c4,segment=NetworkSegment(5d321273-3f83-40d4-be02-80695052ceb8),segment_id=5d321273-3f83-40d4-be02-80695052ceb8)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:59:01.554930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6efbf2c3-cdd5-43c1-9e74-1cd4d911f984 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (18c0ff33-2d95-418b-abd3-b89da402d2c4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:01.962299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:343 started Oct 23 00:59:01.965029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=36000000,duration_sec=703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:01.965735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:01.966035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:343 - starting polling. Elapsed:0.004 Oct 23 00:59:01.969337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:01.974218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:343 - port information retrieved. Elapsed:0.012 Oct 23 00:59:01.974473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:343 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:59:03.962935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:344 started Oct 23 00:59:03.965512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=36000000,duration_sec=705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:03.966099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:03.966452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:344 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:05.798681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 18c0ff33-2d95-418b-abd3-b89da402d2c4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:59:05.799334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (18c0ff33-2d95-418b-abd3-b89da402d2c4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:05.964161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:345 started Oct 23 00:59:05.966844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=38000000,duration_sec=707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:05.967428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:05.967759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:345 - starting polling. Elapsed:0.004 Oct 23 00:59:05.970961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:05.975380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:345 - port information retrieved. Elapsed:0.011 Oct 23 00:59:05.975712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:345 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:59:07.872416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 18c0ff33-2d95-418b-abd3-b89da402d2c4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:59:07.873774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (18c0ff33-2d95-418b-abd3-b89da402d2c4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:07.929812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:59:07.930368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:07.965345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:346 started Oct 23 00:59:07.967784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=39000000,duration_sec=709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:07.968393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:07.968751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:346 - starting polling. Elapsed:0.004 Oct 23 00:59:07.971948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:07.976340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:346 - port information retrieved. Elapsed:0.011 Oct 23 00:59:07.976659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:346 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:59:09.701218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port c4115102-acce-4a90-ab24-eb74a5879146 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 00:59:09.702335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:09.966600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:347 started Oct 23 00:59:09.969533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=40000000,duration_sec=711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:09.970167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:09.970508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:347 - starting polling. Elapsed:0.004 Oct 23 00:59:09.973946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:09.978479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:347 - port information retrieved. Elapsed:0.012 Oct 23 00:59:09.978948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:347 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 00:59:11.967012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:348 started Oct 23 00:59:11.969420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=40000000,duration_sec=713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:11.969984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:11.970332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:348 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 23 00:59:13.967880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:349 started Oct 23 00:59:13.970528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=41000000,duration_sec=715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:13.971103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:13.971453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:349 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:14.463718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-43fb4157-4ecf-4691-89e4-4e14da8739c4 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Resource Port deleted: 18c0ff33-2d95-418b-abd3-b89da402d2c4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:14.465147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-43fb4157-4ecf-4691-89e4-4e14da8739c4 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (18c0ff33-2d95-418b-abd3-b89da402d2c4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:14.465147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-43fb4157-4ecf-4691-89e4-4e14da8739c4 tempest-VolumesActionsTest-622168452 tempest-VolumesActionsTest-622168452-project] Security group member updated {'aee26348-8e69-40a4-ac27-4b922e21afd6'} Oct 23 00:59:15.968112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:350 started Oct 23 00:59:15.970737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=42000000,duration_sec=717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:15.971358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:15.971994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:350 - starting polling. Elapsed:0.004 Oct 23 00:59:15.975412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:15.977949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 18c0ff33-2d95-418b-abd3-b89da402d2c4 not present in bridge br-int Oct 23 00:59:15.978489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 00:59:15.978781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['18c0ff33-2d95-418b-abd3-b89da402d2c4'] Oct 23 00:59:15.979108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 18c0ff33-2d95-418b-abd3-b89da402d2c4 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 00:59:15.985436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:350 - port information retrieved. Elapsed:0.017 Oct 23 00:59:15.985879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:350 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 23 00:59:17.969813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:351 started Oct 23 00:59:17.974028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=44000000,duration_sec=719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:17.974970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:17.975545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:351 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:59:19.971022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:352 started Oct 23 00:59:19.973764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=44000000,duration_sec=721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:19.974562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:19.974912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:352 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:21.972041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:353 started Oct 23 00:59:21.975386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=46000000,duration_sec=723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:21.976572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:21.976994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:353 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:59:23.972677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:354 started Oct 23 00:59:23.978400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2b9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=47000000,duration_sec=725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:23.979302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:23.979882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:354 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 00:59:25.974099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:355 started Oct 23 00:59:25.977679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ba0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=49000000,duration_sec=727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:25.978441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:25.979077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:355 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:59:27.974764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:356 started Oct 23 00:59:27.978503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ba2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=48000000,duration_sec=729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:27.979367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:27.979734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:356 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:59:29.976072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:357 started Oct 23 00:59:29.979165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ba4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=50000000,duration_sec=731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:29.979856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:29.980345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:357 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:59:31.977221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:358 started Oct 23 00:59:31.979916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ba6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=51000000,duration_sec=733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:31.980517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:31.980910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:358 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:33.978295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:359 started Oct 23 00:59:33.981278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ba8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=52000000,duration_sec=735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:33.982195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:33.982789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:359 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:59:35.979720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:360 started Oct 23 00:59:35.982244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2baa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=53000000,duration_sec=737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:35.982909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:35.983161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:360 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:37.616558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-651006ab-06a3-4820-b5c3-fb3d6cfe93be admin admin] Resource Subnet deleted: 5a084bd4-dc2a-4656-9023-88a6c081dfcb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:37.617193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-651006ab-06a3-4820-b5c3-fb3d6cfe93be admin admin] Publish callbacks [] for Subnet (5a084bd4-dc2a-4656-9023-88a6c081dfcb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:37.929841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-36bafeaa-32a8-41bf-b45e-165873ee2ab4 admin admin] Resource Network deleted: 706576df-d255-452e-b7ba-460fee4fb9d4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:37.930657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-36bafeaa-32a8-41bf-b45e-165873ee2ab4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (706576df-d255-452e-b7ba-460fee4fb9d4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:37.980150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:361 started Oct 23 00:59:37.982736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=54000000,duration_sec=739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:37.983372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:37.983731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:361 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:38.217303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Resource SecurityGroup deleted: aee26348-8e69-40a4-ac27-4b922e21afd6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:38.217702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (aee26348-8e69-40a4-ac27-4b922e21afd6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:38.218301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('aee26348-8e69-40a4-ac27-4b922e21afd6',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:59:38.234711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('aee26348-8e69-40a4-ac27-4b922e21afd6',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:59:38.235600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Resource SecurityGroupRule deleted: 1f8880ae-b590-41ac-9848-b7e603d6dc5c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:38.236195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1f8880ae-b590-41ac-9848-b7e603d6dc5c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:38.236531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:59:38.237038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Resource SecurityGroupRule deleted: 24d9bbb2-7260-44b7-8743-a3a52ce6aa33 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:38.237505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (24d9bbb2-7260-44b7-8743-a3a52ce6aa33), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:38.238039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:59:38.238413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Resource SecurityGroupRule deleted: 49188a72-d349-4514-aae6-81fa40ad5dd3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:38.238731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (49188a72-d349-4514-aae6-81fa40ad5dd3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:38.239045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:59:38.239410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Resource SecurityGroupRule deleted: 49bc0d22-3150-4c53-b983-5ac04dad796b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:38.239730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (49bc0d22-3150-4c53-b983-5ac04dad796b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:38.240044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4e139ddb-00ad-4bfb-9296-ae0a24b5361d admin admin] Security group rule updated ['aee26348-8e69-40a4-ac27-4b922e21afd6'] Oct 23 00:59:39.981501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:362 started Oct 23 00:59:39.984082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=55000000,duration_sec=741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:39.984874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:39.985206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:362 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:41.981941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:363 started Oct 23 00:59:41.985484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=56000000,duration_sec=743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:41.986173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:41.986618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:363 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:59:42.336868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T00:59:42Z,description='Default security group',id=7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0,is_default=True,name='default',project_id='ccecf33a0f5c45b28e34f4958d70a3d4',revision_number=1,rules=[SecurityGroupRule(39011f76-c484-4d58-a390-d9a9e3c19020),SecurityGroupRule(8ca16eb7-c89e-4f87-b09d-346b79caaf75),SecurityGroupRule(a418ae00-8d14-449b-868e-d57adc606e04),SecurityGroupRule(f85ead12-8e36-4588-8775-0ef3debf72cd)],shared=False,stateful=True,updated_at=2022-10-23T00:59:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:59:42.337250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.337868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:59:42Z,description=,direction='ingress',ethertype='IPv4',id=39011f76-c484-4d58-a390-d9a9e3c19020,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccecf33a0f5c45b28e34f4958d70a3d4',protocol=,remote_address_group_id=,remote_group_id=7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0,remote_ip_prefix=,revision_number=0,security_group_id=7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0,updated_at=2022-10-23T00:59:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:59:42.338207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (39011f76-c484-4d58-a390-d9a9e3c19020), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.338726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:42.339420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:59:42Z,description=,direction='ingress',ethertype='IPv6',id=8ca16eb7-c89e-4f87-b09d-346b79caaf75,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccecf33a0f5c45b28e34f4958d70a3d4',protocol=,remote_address_group_id=,remote_group_id=7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0,remote_ip_prefix=,revision_number=0,security_group_id=7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0,updated_at=2022-10-23T00:59:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:59:42.339788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8ca16eb7-c89e-4f87-b09d-346b79caaf75), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.340098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:42.340752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:59:42Z,description=,direction='egress',ethertype='IPv6',id=a418ae00-8d14-449b-868e-d57adc606e04,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccecf33a0f5c45b28e34f4958d70a3d4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0,updated_at=2022-10-23T00:59:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:59:42.341106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a418ae00-8d14-449b-868e-d57adc606e04), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.341507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:42.342113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T00:59:42Z,description=,direction='egress',ethertype='IPv4',id=f85ead12-8e36-4588-8775-0ef3debf72cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccecf33a0f5c45b28e34f4958d70a3d4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0,updated_at=2022-10-23T00:59:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 00:59:42.342463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f85ead12-8e36-4588-8775-0ef3debf72cd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.342785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c3b49aab-e475-477a-b99c-079124535b67 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:42.465982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Resource SecurityGroup deleted: 7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:42.466366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.466824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 00:59:42.482420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 00:59:42.483046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Resource SecurityGroupRule deleted: 39011f76-c484-4d58-a390-d9a9e3c19020 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:42.483585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (39011f76-c484-4d58-a390-d9a9e3c19020), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.484107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:42.484748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Resource SecurityGroupRule deleted: 8ca16eb7-c89e-4f87-b09d-346b79caaf75 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:42.485126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8ca16eb7-c89e-4f87-b09d-346b79caaf75), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.485741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:42.486120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Resource SecurityGroupRule deleted: a418ae00-8d14-449b-868e-d57adc606e04 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:42.486872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a418ae00-8d14-449b-868e-d57adc606e04), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.487193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:42.487578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Resource SecurityGroupRule deleted: f85ead12-8e36-4588-8775-0ef3debf72cd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:42.487906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f85ead12-8e36-4588-8775-0ef3debf72cd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:42.488216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-41764c4e-7a1c-40eb-9cc4-c26f3e2ce904 admin admin] Security group rule updated ['7ddeaa0b-cf6d-4f68-9572-c062ed8da4a0'] Oct 23 00:59:43.983572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:364 started Oct 23 00:59:43.987342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=57000000,duration_sec=745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:43.988166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:43.988634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:364 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:59:45.985241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:365 started Oct 23 00:59:45.989404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=59000000,duration_sec=747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:45.990447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:45.990899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:365 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:59:47.986959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:366 started Oct 23 00:59:47.991540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=61000000,duration_sec=749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:47.992519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:47.993130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:366 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:59:49.988463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:367 started Oct 23 00:59:49.992477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=62000000,duration_sec=751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:49.993484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:49.994137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:367 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 00:59:51.989944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:368 started Oct 23 00:59:51.993534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=63000000,duration_sec=753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:51.994415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:51.994887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:368 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 00:59:53.991393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:369 started Oct 23 00:59:53.993936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=65000000,duration_sec=755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:53.994517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:53.994902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:369 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:55.992530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:370 started Oct 23 00:59:55.995676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=66000000,duration_sec=757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:55.996260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:55.996616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:370 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 00:59:57.994077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:371 started Oct 23 00:59:58.005022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=68000000,duration_sec=759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:58.006519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:58.006873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:371 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 00:59:59.974537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-188e3261-23d5-4db9-9a43-45340f61c735 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource Port deleted: c4115102-acce-4a90-ab24-eb74a5879146 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 00:59:59.975281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-188e3261-23d5-4db9-9a43-45340f61c735 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (c4115102-acce-4a90-ab24-eb74a5879146), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 00:59:59.975482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-188e3261-23d5-4db9-9a43-45340f61c735 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group member updated {'de7217fb-3148-4635-a766-93f8b6fd3faa'} Oct 23 00:59:59.995671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:372 started Oct 23 00:59:59.998305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=69000000,duration_sec=761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 00:59:59.999187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 00:59:59.999758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:372 - starting polling. Elapsed:0.005 Oct 23 01:00:00.003328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:00.006148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port c4115102-acce-4a90-ab24-eb74a5879146 not present in bridge br-int Oct 23 01:00:00.006663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:00.007048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['c4115102-acce-4a90-ab24-eb74a5879146'] Oct 23 01:00:00.007470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port c4115102-acce-4a90-ab24-eb74a5879146 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:00.012265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:372 - port information retrieved. Elapsed:0.017 Oct 23 01:00:00.012670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:372 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 23 01:00:01.995529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:373 started Oct 23 01:00:02.003169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=69000000,duration_sec=763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:02.007495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:02.007955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:373 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 01:00:02.093282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7998a182-41c9-41fa-a226-629335b406f4 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port deleted: 29611acb-94f0-4480-8d4d-aaf6303b062c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:02.093742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7998a182-41c9-41fa-a226-629335b406f4 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (29611acb-94f0-4480-8d4d-aaf6303b062c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:02.094217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7998a182-41c9-41fa-a226-629335b406f4 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group member updated {'9e47da15-b648-4e05-8264-514053b0be27'} Oct 23 01:00:02.294940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroup deleted: de7217fb-3148-4635-a766-93f8b6fd3faa {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:02.295525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (de7217fb-3148-4635-a766-93f8b6fd3faa), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:02.296043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('de7217fb-3148-4635-a766-93f8b6fd3faa',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:00:02.317421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('de7217fb-3148-4635-a766-93f8b6fd3faa',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:00:02.317421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: 4bfe63a0-41a6-47cc-8cee-f74f9a553650 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:02.317421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4bfe63a0-41a6-47cc-8cee-f74f9a553650), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:02.317421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 01:00:02.317914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: 81b9d63a-35d4-4d42-bf5d-bdecd70d472c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:02.317914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (81b9d63a-35d4-4d42-bf5d-bdecd70d472c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:02.317914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 01:00:02.317914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: eff17224-53e4-4cbc-a3ce-704b6a8dd48f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:02.318342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (eff17224-53e4-4cbc-a3ce-704b6a8dd48f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:02.321464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 01:00:02.321933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: ea11ce43-6a10-4eeb-af76-7dc94282ebc1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:02.322292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ea11ce43-6a10-4eeb-af76-7dc94282ebc1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:02.322607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fd61dd30-1a3e-4a18-85cf-3125295a0d53 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['de7217fb-3148-4635-a766-93f8b6fd3faa'] Oct 23 01:00:02.753931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ff6f8fad-6ca6-4d88-a1aa-8ede34edff61 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource Port deleted: ef9908ec-665e-42ab-9646-863c5d00d20a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:02.754514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ff6f8fad-6ca6-4d88-a1aa-8ede34edff61 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (ef9908ec-665e-42ab-9646-863c5d00d20a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:03.141660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:00:03Z,description='tempest-description--689182412',id=a78952a2-cccd-48f5-8f51-83df3683dcf4,is_default=False,name='tempest-securitygroup--1082989617',project_id='59add4b78cd346a194c4be211d1996be',revision_number=1,rules=[SecurityGroupRule(30ab51a9-2df6-42d8-8785-3feb901b8c77),SecurityGroupRule(e7c41469-495c-4d03-925b-dbe3afc92f13)],shared=False,stateful=True,updated_at=2022-10-23T01:00:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:03.145396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (a78952a2-cccd-48f5-8f51-83df3683dcf4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:03.146195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:03Z,description=,direction='egress',ethertype='IPv6',id=30ab51a9-2df6-42d8-8785-3feb901b8c77,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a78952a2-cccd-48f5-8f51-83df3683dcf4,updated_at=2022-10-23T01:00:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:03.147859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (30ab51a9-2df6-42d8-8785-3feb901b8c77), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:03.148986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:00:03.156275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:03Z,description=,direction='egress',ethertype='IPv4',id=e7c41469-495c-4d03-925b-dbe3afc92f13,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a78952a2-cccd-48f5-8f51-83df3683dcf4,updated_at=2022-10-23T01:00:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:03.156650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e7c41469-495c-4d03-925b-dbe3afc92f13), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:03.157081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1d7ffab7-6968-40c2-aa2f-28e3a889f6c9 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:00:03.293191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-65bd19b2-c1b6-4406-943f-1721b1a2d47d tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:03Z,description='',direction='ingress',ethertype='IPv4',id=2e5faaee-3cce-4c42-a582-0e626f4342d3,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='59add4b78cd346a194c4be211d1996be',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a78952a2-cccd-48f5-8f51-83df3683dcf4,updated_at=2022-10-23T01:00:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:03.293591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-65bd19b2-c1b6-4406-943f-1721b1a2d47d tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2e5faaee-3cce-4c42-a582-0e626f4342d3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:03.297149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-65bd19b2-c1b6-4406-943f-1721b1a2d47d tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:00:03.442636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-75f7c1db-6596-4693-9560-4e7b2e064f5b tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:03Z,description='',direction='ingress',ethertype='IPv4',id=76e5cc8c-bb60-4e03-8008-ad43e0fba1b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59add4b78cd346a194c4be211d1996be',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a78952a2-cccd-48f5-8f51-83df3683dcf4,updated_at=2022-10-23T01:00:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:03.443486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-75f7c1db-6596-4693-9560-4e7b2e064f5b tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (76e5cc8c-bb60-4e03-8008-ad43e0fba1b7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:03.443991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-75f7c1db-6596-4693-9560-4e7b2e064f5b tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:00:03.923825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-79854aba-3d34-4be9-8e40-425a05a97012 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:03Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=451ffa52-bde4-4d4d-bb86-4181fb85999c,mac_address=fa:16:3e:4d:fa:51,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(451ffa52-bde4-4d4d-bb86-4181fb85999c),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:00:03Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:03.924310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-79854aba-3d34-4be9-8e40-425a05a97012 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (451ffa52-bde4-4d4d-bb86-4181fb85999c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:03.996913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:374 started Oct 23 01:00:03.999553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=70000000,duration_sec=765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:04.000163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:04.000502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:374 - starting polling. Elapsed:0.004 Oct 23 01:00:04.003707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:04.005970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 29611acb-94f0-4480-8d4d-aaf6303b062c not present in bridge br-int Oct 23 01:00:04.006309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:04.008314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port ef9908ec-665e-42ab-9646-863c5d00d20a not present in bridge br-int Oct 23 01:00:04.008628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:04.008920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['ef9908ec-665e-42ab-9646-863c5d00d20a', '29611acb-94f0-4480-8d4d-aaf6303b062c'] Oct 23 01:00:04.009297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port ef9908ec-665e-42ab-9646-863c5d00d20a is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:04.009544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 29611acb-94f0-4480-8d4d-aaf6303b062c is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:04.014199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:374 - port information retrieved. Elapsed:0.017 Oct 23 01:00:04.014523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:374 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 23 01:00:04.275583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-79854aba-3d34-4be9-8e40-425a05a97012 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource Port 451ffa52-bde4-4d4d-bb86-4181fb85999c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '1d934081-b57f-4715-b188-9bc52aaecccf'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:04.276207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-79854aba-3d34-4be9-8e40-425a05a97012 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (451ffa52-bde4-4d4d-bb86-4181fb85999c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:05.998179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:375 started Oct 23 01:00:06.002333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=72000000,duration_sec=767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:06.003041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:06.003482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:375 - starting polling. Elapsed:0.006 Oct 23 01:00:06.008535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:06.015554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:375 - port information retrieved. Elapsed:0.018 Oct 23 01:00:06.015935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:375 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 23 01:00:07.999836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:376 started Oct 23 01:00:08.004535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=74000000,duration_sec=769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:08.005255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:08.005620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:376 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:00:08.372018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc5127f3-6515-4b3a-aa2b-cf04e20bb027 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource Port deleted: 16ac40d6-7a56-4def-a9f5-e0a3fade7563 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:08.374030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bc5127f3-6515-4b3a-aa2b-cf04e20bb027 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (16ac40d6-7a56-4def-a9f5-e0a3fade7563), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:08.374619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bc5127f3-6515-4b3a-aa2b-cf04e20bb027 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group member updated {'eab29425-121c-4f20-9db4-0aad6675d57d'} Oct 23 01:00:09.724706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3472e79a-51d6-4389-8fa1-5960185ddccc tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:08Z,data_plane_status=None,description='',device_id='05feffd4-1aa7-45d8-ba10-5af50ee7ec77',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3852bda4-a273-400c-a77a-8c3bd9a04a63,mac_address=fa:16:3e:7f:f7:ff,name='',network_id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,numa_affinity_policy=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3852bda4-a273-400c-a77a-8c3bd9a04a63),security_group_ids=set([9e47da15-b648-4e05-8264-514053b0be27]),status='DOWN',updated_at=2022-10-23T01:00:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:09.726661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3472e79a-51d6-4389-8fa1-5960185ddccc tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3852bda4-a273-400c-a77a-8c3bd9a04a63), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:09.726661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3472e79a-51d6-4389-8fa1-5960185ddccc tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group member updated {'9e47da15-b648-4e05-8264-514053b0be27'} Oct 23 01:00:10.000849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:377 started Oct 23 01:00:10.004108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bcc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=74000000,duration_sec=771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:10.004700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:10.005247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:377 - starting polling. Elapsed:0.005 Oct 23 01:00:10.008639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.013813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 16ac40d6-7a56-4def-a9f5-e0a3fade7563 not present in bridge br-int Oct 23 01:00:10.013962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:10.014397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['16ac40d6-7a56-4def-a9f5-e0a3fade7563'] Oct 23 01:00:10.014884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 16ac40d6-7a56-4def-a9f5-e0a3fade7563 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:10.019949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:377 - port information retrieved. Elapsed:0.019 Oct 23 01:00:10.020437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:377 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 23 01:00:10.043652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ee47a627-2d03-4ba1-9245-2483347721c0 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:09Z,data_plane_status=None,description='',device_id='17825340-b12a-4d69-9248-6fee9379135f',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554,mac_address=fa:16:3e:c7:f9:0c,name='',network_id=f8105e98-346f-4369-be4d-2cb2d399c07a,numa_affinity_policy=,project_id='59add4b78cd346a194c4be211d1996be',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554),security_group_ids=set([a78952a2-cccd-48f5-8f51-83df3683dcf4]),status='DOWN',updated_at=2022-10-23T01:00:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:10.044095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ee47a627-2d03-4ba1-9245-2483347721c0 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.044545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ee47a627-2d03-4ba1-9245-2483347721c0 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group member updated {'a78952a2-cccd-48f5-8f51-83df3683dcf4'} Oct 23 01:00:10.681718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroup deleted: eab29425-121c-4f20-9db4-0aad6675d57d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:10.682092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (eab29425-121c-4f20-9db4-0aad6675d57d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.682774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('eab29425-121c-4f20-9db4-0aad6675d57d',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:00:10.702820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1508326c-9c07-4db1-9749-350472736b92 service neutron] Resource Port 3852bda4-a273-400c-a77a-8c3bd9a04a63 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=3852bda4-a273-400c-a77a-8c3bd9a04a63,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3852bda4-a273-400c-a77a-8c3bd9a04a63,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:10.703482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1508326c-9c07-4db1-9749-350472736b92 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3852bda4-a273-400c-a77a-8c3bd9a04a63), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.704326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('eab29425-121c-4f20-9db4-0aad6675d57d',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:00:10.704882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: 73427c94-904e-4268-ba7c-9cb1683a1edf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:10.705230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (73427c94-904e-4268-ba7c-9cb1683a1edf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.705550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 01:00:10.706203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: b9953073-a1f9-4d10-8748-02de2be40e50 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:10.706793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b9953073-a1f9-4d10-8748-02de2be40e50), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.707170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 01:00:10.707689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: 8d4d375d-2751-4c38-bbdc-ee99bd63da89 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:10.708039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8d4d375d-2751-4c38-bbdc-ee99bd63da89), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.708357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 01:00:10.708757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: 5b7853dd-917c-47c4-89a0-cd6e9d6d5236 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:10.709092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5b7853dd-917c-47c4-89a0-cd6e9d6d5236), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:10.709574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eac7883d-5915-4b79-ac29-d0c126e4c01e tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['eab29425-121c-4f20-9db4-0aad6675d57d'] Oct 23 01:00:11.076442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8a69b271-7f7b-4c1a-b002-48d5a46196b1 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource Port deleted: fcda428b-426f-4c8d-b0c2-a33f31d90d05 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:11.076442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8a69b271-7f7b-4c1a-b002-48d5a46196b1 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (fcda428b-426f-4c8d-b0c2-a33f31d90d05), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:11.332268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-949c137b-fde7-4f84-8ab0-7f1ea24e9f8b service neutron] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:11.332649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-949c137b-fde7-4f84-8ab0-7f1ea24e9f8b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:11.706687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1508326c-9c07-4db1-9749-350472736b92 service neutron] Resource Port 3852bda4-a273-400c-a77a-8c3bd9a04a63 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3852bda4-a273-400c-a77a-8c3bd9a04a63,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3852bda4-a273-400c-a77a-8c3bd9a04a63,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=3852bda4-a273-400c-a77a-8c3bd9a04a63,segment=NetworkSegment(d3b56b04-e2e1-4f00-a9db-1de40f8c425f),segment_id=d3b56b04-e2e1-4f00-a9db-1de40f8c425f)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:11.707136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1508326c-9c07-4db1-9749-350472736b92 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3852bda4-a273-400c-a77a-8c3bd9a04a63), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:11.814978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:00:11Z,description='tempest-description--170622532',id=99b637e5-7b4a-4535-a0f5-900744a58770,is_default=False,name='tempest-securitygroup--1199000763',project_id='2a9697845193443ea394c1b480b6b769',revision_number=1,rules=[SecurityGroupRule(0e2ec046-e1de-4966-a905-9eedc247f6d4),SecurityGroupRule(f4adcb1b-044d-41b2-841a-0e4f45ffa365)],shared=False,stateful=True,updated_at=2022-10-23T01:00:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:11.815888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (99b637e5-7b4a-4535-a0f5-900744a58770), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:11.817037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:11Z,description=,direction='egress',ethertype='IPv4',id=0e2ec046-e1de-4966-a905-9eedc247f6d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=99b637e5-7b4a-4535-a0f5-900744a58770,updated_at=2022-10-23T01:00:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:11.817905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0e2ec046-e1de-4966-a905-9eedc247f6d4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:11.818282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:00:11.819134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:11Z,description=,direction='egress',ethertype='IPv6',id=f4adcb1b-044d-41b2-841a-0e4f45ffa365,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=99b637e5-7b4a-4535-a0f5-900744a58770,updated_at=2022-10-23T01:00:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:11.819656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f4adcb1b-044d-41b2-841a-0e4f45ffa365), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:11.820227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-eb2bd862-706d-48d5-b504-da6c0a6bc5a0 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:00:11.938586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e7e7501e-f77c-42b9-a75d-8cbbc1c1cd9b tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:11Z,description='',direction='ingress',ethertype='IPv4',id=5e7676d6-9e1a-44d8-a463-f30f823c2f74,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='2a9697845193443ea394c1b480b6b769',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=99b637e5-7b4a-4535-a0f5-900744a58770,updated_at=2022-10-23T01:00:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:11.939285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e7e7501e-f77c-42b9-a75d-8cbbc1c1cd9b tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5e7676d6-9e1a-44d8-a463-f30f823c2f74), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:11.939778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e7e7501e-f77c-42b9-a75d-8cbbc1c1cd9b tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:00:12.002051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:378 started Oct 23 01:00:12.006512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=76000000,duration_sec=773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:12.007822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:12.008851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:378 - starting polling. Elapsed:0.006 Oct 23 01:00:12.012535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:12.015226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port fcda428b-426f-4c8d-b0c2-a33f31d90d05 not present in bridge br-int Oct 23 01:00:12.015583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:12.015832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['fcda428b-426f-4c8d-b0c2-a33f31d90d05'] Oct 23 01:00:12.016292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port fcda428b-426f-4c8d-b0c2-a33f31d90d05 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:12.021279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:378 - port information retrieved. Elapsed:0.019 Oct 23 01:00:12.021651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:378 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 23 01:00:12.075869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c4095608-9cec-4ae2-8267-e05f3b3d432a tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:12Z,description='',direction='ingress',ethertype='IPv4',id=90652faf-d6a1-42f9-aa7f-9438e30e150a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2a9697845193443ea394c1b480b6b769',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=99b637e5-7b4a-4535-a0f5-900744a58770,updated_at=2022-10-23T01:00:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:12.076659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c4095608-9cec-4ae2-8267-e05f3b3d432a tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (90652faf-d6a1-42f9-aa7f-9438e30e150a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:12.078417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c4095608-9cec-4ae2-8267-e05f3b3d432a tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:00:12.210234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-949c137b-fde7-4f84-8ab0-7f1ea24e9f8b service neutron] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554,segment=NetworkSegment(7dc83201-cb39-4cd2-9302-c1b785eda914),segment_id=7dc83201-cb39-4cd2-9302-c1b785eda914)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:12.210718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-949c137b-fde7-4f84-8ab0-7f1ea24e9f8b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:12.522457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba1f43be-ea10-4064-b6e0-6d5ace595dc8 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:12Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=76e0a054-229e-4284-83a4-cb25bcb1c471,mac_address=fa:16:3e:0f:ed:87,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(76e0a054-229e-4284-83a4-cb25bcb1c471),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:00:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:12.522757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba1f43be-ea10-4064-b6e0-6d5ace595dc8 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (76e0a054-229e-4284-83a4-cb25bcb1c471), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:12.883291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ba1f43be-ea10-4064-b6e0-6d5ace595dc8 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource Port 76e0a054-229e-4284-83a4-cb25bcb1c471 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'bcd16f17-3cff-4719-acf1-5e472bcc2af0'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:12.883937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ba1f43be-ea10-4064-b6e0-6d5ace595dc8 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (76e0a054-229e-4284-83a4-cb25bcb1c471), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:14.003438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:379 started Oct 23 01:00:14.006580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=77000000,duration_sec=775,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:14.008409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:14.009230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:379 - starting polling. Elapsed:0.006 Oct 23 01:00:14.013378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:14.020206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:379 - port information retrieved. Elapsed:0.016 Oct 23 01:00:14.020612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:379 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 01:00:14.102067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:14.102793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:16.009534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:380 started Oct 23 01:00:16.019966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=87000000,duration_sec=777,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:16.021217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:16.021582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:380 - starting polling. Elapsed:0.012 Oct 23 01:00:16.032787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:16.038947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:380 - port information retrieved. Elapsed:0.029 Oct 23 01:00:16.039552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:380 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.030 Oct 23 01:00:16.046327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:16.046950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:16.273391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a2c23830-71c7-4b4f-bac6-27bda8c40697 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:15Z,data_plane_status=None,description='',device_id='cbb7e3cd-fd44-4878-9b38-d01f6247c24a',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=752bf309-e01c-493c-aa69-b31be007e882,mac_address=fa:16:3e:08:0a:ff,name='',network_id=6e24fc8d-42d5-4d11-b06b-37a4738231b0,numa_affinity_policy=,project_id='2a9697845193443ea394c1b480b6b769',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(752bf309-e01c-493c-aa69-b31be007e882),security_group_ids=set([99b637e5-7b4a-4535-a0f5-900744a58770]),status='DOWN',updated_at=2022-10-23T01:00:15Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:16.273773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a2c23830-71c7-4b4f-bac6-27bda8c40697 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (752bf309-e01c-493c-aa69-b31be007e882), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:16.274225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a2c23830-71c7-4b4f-bac6-27bda8c40697 tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group member updated {'99b637e5-7b4a-4535-a0f5-900744a58770'} Oct 23 01:00:17.046593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9a6e1197-0bf2-4db3-a8b9-606fc9ca15bb service neutron] Resource Port 752bf309-e01c-493c-aa69-b31be007e882 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=752bf309-e01c-493c-aa69-b31be007e882,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=752bf309-e01c-493c-aa69-b31be007e882,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:17.047271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9a6e1197-0bf2-4db3-a8b9-606fc9ca15bb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (752bf309-e01c-493c-aa69-b31be007e882), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:17.482596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9a6e1197-0bf2-4db3-a8b9-606fc9ca15bb service neutron] Resource Port 752bf309-e01c-493c-aa69-b31be007e882 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=752bf309-e01c-493c-aa69-b31be007e882,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=752bf309-e01c-493c-aa69-b31be007e882,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=752bf309-e01c-493c-aa69-b31be007e882,segment=NetworkSegment(6c7f3988-5c29-4b49-bf43-a45d839e2e81),segment_id=6c7f3988-5c29-4b49-bf43-a45d839e2e81)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:17.483004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9a6e1197-0bf2-4db3-a8b9-606fc9ca15bb service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (752bf309-e01c-493c-aa69-b31be007e882), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:18.012938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:381 started Oct 23 01:00:18.015797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=87000000,duration_sec=779,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:18.016610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:18.016967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:381 - starting polling. Elapsed:0.006 Oct 23 01:00:18.020090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:18.024369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:381 - port information retrieved. Elapsed:0.014 Oct 23 01:00:18.024701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:381 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 01:00:20.012030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:382 started Oct 23 01:00:20.014604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=85000000,duration_sec=781,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:20.015615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:20.015970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:382 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:00:20.040315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 3852bda4-a273-400c-a77a-8c3bd9a04a63 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:20.040747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3852bda4-a273-400c-a77a-8c3bd9a04a63), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:22.012907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:383 started Oct 23 01:00:22.015641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=86000000,duration_sec=783,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:22.016217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:22.016549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:383 - starting polling. Elapsed:0.004 Oct 23 01:00:22.019680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:22.024029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:383 - port information retrieved. Elapsed:0.011 Oct 23 01:00:22.024359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:383 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 01:00:22.204005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 3852bda4-a273-400c-a77a-8c3bd9a04a63 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:22.204528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (3852bda4-a273-400c-a77a-8c3bd9a04a63), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:22.252690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 752bf309-e01c-493c-aa69-b31be007e882 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:22.253092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (752bf309-e01c-493c-aa69-b31be007e882), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.013907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:384 started Oct 23 01:00:24.017452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=88000000,duration_sec=785,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:24.019498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:24.019950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:384 - starting polling. Elapsed:0.006 Oct 23 01:00:24.025409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.031336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:384 - port information retrieved. Elapsed:0.018 Oct 23 01:00:24.031845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:384 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 23 01:00:24.086254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 752bf309-e01c-493c-aa69-b31be007e882 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:24.086712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (752bf309-e01c-493c-aa69-b31be007e882), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.680846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-20451b27-c834-4292-bf8a-65fe49d218ef tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 updated (revision_number 6->7). Old fields: {'security_group_ids': CoercedSet({'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5', 'ec73b002-330e-47cc-a826-68d3bc97dba7'})} New fields: {'security_group_ids': CoercedSet({'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'})} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:24.681293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-20451b27-c834-4292-bf8a-65fe49d218ef tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.681919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-20451b27-c834-4292-bf8a-65fe49d218ef tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group member updated {'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5', 'ec73b002-330e-47cc-a826-68d3bc97dba7'} Oct 23 01:00:24.953132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroup deleted: ec73b002-330e-47cc-a826-68d3bc97dba7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.956168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (ec73b002-330e-47cc-a826-68d3bc97dba7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.956920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ec73b002-330e-47cc-a826-68d3bc97dba7',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:00:24.981256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ec73b002-330e-47cc-a826-68d3bc97dba7',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:00:24.982621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: 6a3a6503-38df-4768-abbf-0363e2f78bf8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.983495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6a3a6503-38df-4768-abbf-0363e2f78bf8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.984048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:24.984645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: 6fe5ce8d-ec0f-4fa2-800d-a927760f3502 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.985838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6fe5ce8d-ec0f-4fa2-800d-a927760f3502), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.986401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:24.987361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: a482dd5d-6fe8-456d-adbe-a8c53e1ccec3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.989324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a482dd5d-6fe8-456d-adbe-a8c53e1ccec3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.990056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:24.990751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: c163b1ea-f6c7-4c2a-b8d1-7ff520a28e0b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.991350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c163b1ea-f6c7-4c2a-b8d1-7ff520a28e0b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.992060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:24.992980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: 88874361-23cc-4f91-bf53-df4c67549e21 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.995169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (88874361-23cc-4f91-bf53-df4c67549e21), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.996086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:24.996980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: 6ff16eec-bbf1-4ecb-82c9-de251207f140 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.997757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6ff16eec-bbf1-4ecb-82c9-de251207f140), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:24.998319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:24.999022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: 986c172c-fdc1-4b08-92c6-13758aef3038 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:24.999905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (986c172c-fdc1-4b08-92c6-13758aef3038), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:25.000435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:25.001624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource SecurityGroupRule deleted: 7aa2f5e2-4393-4db5-9c05-73a32f10e9d1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:25.002603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7aa2f5e2-4393-4db5-9c05-73a32f10e9d1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:25.003675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ae940ed0-f2c7-4339-88fa-f1edfa77c23e tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group rule updated ['ec73b002-330e-47cc-a826-68d3bc97dba7'] Oct 23 01:00:25.575548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-af65d321-9088-462d-b45c-5c1dcb0b3671 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource Port deleted: 5e5d53f2-8969-4a48-aafc-fdbdd3b240da {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:25.576188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-af65d321-9088-462d-b45c-5c1dcb0b3671 tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (5e5d53f2-8969-4a48-aafc-fdbdd3b240da), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:26.014600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:385 started Oct 23 01:00:26.019065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bdc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=89000000,duration_sec=787,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:26.020103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:26.020624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:385 - starting polling. Elapsed:0.006 Oct 23 01:00:26.027039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:26.029881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 5e5d53f2-8969-4a48-aafc-fdbdd3b240da not present in bridge br-int Oct 23 01:00:26.031057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:26.031412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['5e5d53f2-8969-4a48-aafc-fdbdd3b240da'] Oct 23 01:00:26.031801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 5e5d53f2-8969-4a48-aafc-fdbdd3b240da is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:26.036581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:385 - port information retrieved. Elapsed:0.022 Oct 23 01:00:26.037263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:385 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Oct 23 01:00:27.922619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ecc9b47-fb15-4fd9-b154-d6c9075c5844 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource Port deleted: 77da0074-6006-4aa3-98e5-60bc673f4b72 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:27.923233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ecc9b47-fb15-4fd9-b154-d6c9075c5844 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (77da0074-6006-4aa3-98e5-60bc673f4b72), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:27.923605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4ecc9b47-fb15-4fd9-b154-d6c9075c5844 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group member updated {'2024e950-6bc4-4c6f-8358-200660ce4c9f'} Oct 23 01:00:28.015832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:386 started Oct 23 01:00:28.018340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=89000000,duration_sec=789,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:28.018958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:28.019296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:386 - starting polling. Elapsed:0.004 Oct 23 01:00:28.022443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:28.024752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 77da0074-6006-4aa3-98e5-60bc673f4b72 not present in bridge br-int Oct 23 01:00:28.024986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:28.025289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['77da0074-6006-4aa3-98e5-60bc673f4b72'] Oct 23 01:00:28.025592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 77da0074-6006-4aa3-98e5-60bc673f4b72 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:28.030165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:386 - port information retrieved. Elapsed:0.015 Oct 23 01:00:28.030710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:386 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 23 01:00:29.558114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cfe2ae09-b656-44a8-adfe-ec1cac35776c tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:29Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e,mac_address=fa:16:3e:22:19:32,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:00:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:29.559689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cfe2ae09-b656-44a8-adfe-ec1cac35776c tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.016228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:387 started Oct 23 01:00:30.019773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2be0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=90000000,duration_sec=791,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:30.020640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:30.021150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:387 - starting polling. Elapsed:0.005 Oct 23 01:00:30.032516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.042227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:387 - port information retrieved. Elapsed:0.026 Oct 23 01:00:30.043015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:387 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Oct 23 01:00:30.372615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cfe2ae09-b656-44a8-adfe-ec1cac35776c tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port 0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'a58c86da-0dd0-4bf7-aabd-7418863b2e11'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:30.373114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cfe2ae09-b656-44a8-adfe-ec1cac35776c tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.743557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource SecurityGroup deleted: 2024e950-6bc4-4c6f-8358-200660ce4c9f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:30.744402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (2024e950-6bc4-4c6f-8358-200660ce4c9f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.745290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2024e950-6bc4-4c6f-8358-200660ce4c9f',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:00:30.760316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2024e950-6bc4-4c6f-8358-200660ce4c9f',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:00:30.761531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource SecurityGroupRule deleted: 3c4f9444-961d-4f9d-86d9-dbd400f59bb5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:30.762016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3c4f9444-961d-4f9d-86d9-dbd400f59bb5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.762491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 01:00:30.763008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource SecurityGroupRule deleted: c8bf6a6d-7c6e-45af-b8a5-f6abc8a41e79 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:30.763436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c8bf6a6d-7c6e-45af-b8a5-f6abc8a41e79), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.763867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 01:00:30.764354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource SecurityGroupRule deleted: 7d37275f-910d-463a-8697-c8f931d757a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:30.764829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7d37275f-910d-463a-8697-c8f931d757a8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.765231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 01:00:30.765877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource SecurityGroupRule deleted: 743deb65-d71b-4dc6-8f3d-24409be6e439 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:30.766299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (743deb65-d71b-4dc6-8f3d-24409be6e439), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:30.766708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-70f940e2-2554-4f95-8470-584a4417ebf8 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group rule updated ['2024e950-6bc4-4c6f-8358-200660ce4c9f'] Oct 23 01:00:31.588260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c14d3159-14dd-4956-ba38-542230b638dc tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource Port deleted: 429a622c-7d0f-4dfa-9be6-a7e9e54da9b0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:31.588760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c14d3159-14dd-4956-ba38-542230b638dc tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (429a622c-7d0f-4dfa-9be6-a7e9e54da9b0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:32.021575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:388 started Oct 23 01:00:32.024029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2be2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=95000000,duration_sec=793,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:32.024595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:32.025036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:388 - starting polling. Elapsed:0.004 Oct 23 01:00:32.028992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:32.031813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 429a622c-7d0f-4dfa-9be6-a7e9e54da9b0 not present in bridge br-int Oct 23 01:00:32.032131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:32.032832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['429a622c-7d0f-4dfa-9be6-a7e9e54da9b0'] Oct 23 01:00:32.033210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 429a622c-7d0f-4dfa-9be6-a7e9e54da9b0 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:32.037627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:388 - port information retrieved. Elapsed:0.016 Oct 23 01:00:32.038030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:388 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 01:00:34.022352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:389 started Oct 23 01:00:34.025899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2be4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=96000000,duration_sec=795,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:34.026740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:34.027351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:389 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:00:34.118492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-23a25284-17f8-4b93-a534-120a18ef8f4d tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Resource Port deleted: 03b8c8cc-3573-4004-a318-cc6ea8e45066 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:34.119192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-23a25284-17f8-4b93-a534-120a18ef8f4d tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (03b8c8cc-3573-4004-a318-cc6ea8e45066), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:34.119795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-23a25284-17f8-4b93-a534-120a18ef8f4d tempest-TestMinimumBasicScenario-1777872522 tempest-TestMinimumBasicScenario-1777872522-project] Security group member updated {'ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'} Oct 23 01:00:36.023617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:390 started Oct 23 01:00:36.028068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2be6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=97000000,duration_sec=797,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:36.029000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:36.029520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:390 - starting polling. Elapsed:0.006 Oct 23 01:00:36.034376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:36.037771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 not present in bridge br-int Oct 23 01:00:36.038317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:36.038744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['03b8c8cc-3573-4004-a318-cc6ea8e45066'] Oct 23 01:00:36.039228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 03b8c8cc-3573-4004-a318-cc6ea8e45066 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:36.045855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:390 - port information retrieved. Elapsed:0.023 Oct 23 01:00:36.046354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:390 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Oct 23 01:00:36.948178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-02edf787-bdf9-48f0-9489-999f78961840 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource Port deleted: 070636ae-227f-400c-a9d9-cd7af698e161 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:36.948561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-02edf787-bdf9-48f0-9489-999f78961840 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (070636ae-227f-400c-a9d9-cd7af698e161), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:36.948994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-02edf787-bdf9-48f0-9489-999f78961840 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group member updated {'b1d06491-a7a6-44ee-b7c2-32677dbd87bd'} Oct 23 01:00:38.024636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:391 started Oct 23 01:00:38.027564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2be8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=98000000,duration_sec=799,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:38.028160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:38.028553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:391 - starting polling. Elapsed:0.004 Oct 23 01:00:38.032643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:38.034682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 070636ae-227f-400c-a9d9-cd7af698e161 not present in bridge br-int Oct 23 01:00:38.035024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:38.035314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['070636ae-227f-400c-a9d9-cd7af698e161'] Oct 23 01:00:38.035769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 070636ae-227f-400c-a9d9-cd7af698e161 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:38.039905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:391 - port information retrieved. Elapsed:0.015 Oct 23 01:00:38.040240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:391 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 23 01:00:39.039909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0253930b-6c8b-4b87-906e-947f0076009b admin admin] Resource Port deleted: 3f16f421-4b09-4db8-bb39-036024ad1e08 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:39.040594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0253930b-6c8b-4b87-906e-947f0076009b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (3f16f421-4b09-4db8-bb39-036024ad1e08), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:40.025451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:392 started Oct 23 01:00:40.028228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=99000000,duration_sec=801,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:40.028977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:40.029496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:392 - starting polling. Elapsed:0.004 Oct 23 01:00:40.032802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:40.037480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3f16f421-4b, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:40.045338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2bec,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:40.045987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['3f16f421-4b09-4db8-bb39-036024ad1e08'] Oct 23 01:00:40.046313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:40.090224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3e48eb-e504-4716-920f-5dbe3cf8bfcf]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:40.096123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:392 - port information retrieved. Elapsed:0.071 Oct 23 01:00:40.096666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:392 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.071 Oct 23 01:00:40.204242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["afd3f2f8-c1fc-46a5-956f-b97d2bde069d","delete","qr-3f16f421-4b",25,["map",[["attached-mac","fa:16:3e:c8:e9:92"],["iface-id","3f16f421-4b09-4db8-bb39-036024ad1e08"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:40.325586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-48a66c53-1c3a-4497-a8d6-99caf7f14377 admin admin] Resource Port deleted: ec2a1257-8a89-482a-b313-cba09c2f2203 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:40.325797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-48a66c53-1c3a-4497-a8d6-99caf7f14377 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (ec2a1257-8a89-482a-b313-cba09c2f2203), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:40.608324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6f83f2b9-5d2a-4705-93f6-2bcefeb51e0f","delete","qg-ec2a1257-8a",26,["map",[["attached-mac","fa:16:3e:57:e0:52"],["iface-id","ec2a1257-8a89-482a-b313-cba09c2f2203"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:41.079757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3109bd3c-22ad-4673-9345-d5806dd880af admin admin] Resource Subnet deleted: 943dfaf8-c12c-409b-b313-a2e572eba44f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:41.080488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3109bd3c-22ad-4673-9345-d5806dd880af admin admin] Publish callbacks [] for Subnet (943dfaf8-c12c-409b-b313-a2e572eba44f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:41.229788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cac4c048-b694-4b59-859f-d287faf27a48","delete","tap503e26a7-75",24,["map",[["attached-mac","fa:16:3e:1e:6c:f3"],["iface-id","503e26a7-75c9-489f-b284-76bdedd789ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:41.552537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16580029-fecb-4d73-b772-c65b5af752e5 admin admin] Resource Port deleted: 503e26a7-75c9-489f-b284-76bdedd789ba {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:41.553005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16580029-fecb-4d73-b772-c65b5af752e5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (503e26a7-75c9-489f-b284-76bdedd789ba), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:41.650528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0bcfb6e-6cf1-4c8d-bdf9-258f6e3fd81b None None] Resource Port deleted: 503e26a7-75c9-489f-b284-76bdedd789ba {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:41.651649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0bcfb6e-6cf1-4c8d-bdf9-258f6e3fd81b None None] Skipped duplicate delete event for 503e26a7-75c9-489f-b284-76bdedd789ba {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:00:41.996056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-16580029-fecb-4d73-b772-c65b5af752e5 admin admin] Resource Network deleted: a82fecef-3e22-41fa-8192-25cadd682e03 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:41.996927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-16580029-fecb-4d73-b772-c65b5af752e5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (a82fecef-3e22-41fa-8192-25cadd682e03), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:42.026356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:393 started Oct 23 01:00:42.028762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=100000000,duration_sec=803,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:42.029533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:42.030328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:393 - starting polling. Elapsed:0.004 Oct 23 01:00:42.034180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:42.042971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2bf0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:42.044396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2bf2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:42.047354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2bf4,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:42.047970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:393 - port information retrieved. Elapsed:0.022 Oct 23 01:00:42.048314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '4a7cd454-b41b-4353-a8da-dd92a4f996c1', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '41fed497-9616-4065-81c5-649cbe8895a8', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': {'3f16f421-4b09-4db8-bb39-036024ad1e08', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '503e26a7-75c9-489f-b284-76bdedd789ba'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:00:42.048635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:393 - agent port security group processed in 0.000 Oct 23 01:00:42.052071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:00:42.052391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'3f16f421-4b09-4db8-bb39-036024ad1e08', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '503e26a7-75c9-489f-b284-76bdedd789ba'} Oct 23 01:00:42.052705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 3f16f421-4b09-4db8-bb39-036024ad1e08 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:42.053343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:42.110460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-58f103da-6cf3-4bef-9e95-b22d90ea4fb7 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Resource Port deleted: fdd89988-ac0b-48a6-9a93-d8efc80c0957 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:42.111055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-58f103da-6cf3-4bef-9e95-b22d90ea4fb7 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (fdd89988-ac0b-48a6-9a93-d8efc80c0957), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:42.113233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-58f103da-6cf3-4bef-9e95-b22d90ea4fb7 tempest-ServerRescueNegativeTestJSON-1390519759 tempest-ServerRescueNegativeTestJSON-1390519759-project] Security group member updated {'b1d06491-a7a6-44ee-b7c2-32677dbd87bd'} Oct 23 01:00:42.114034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fec04e-b395-4aa8-9fc6-248edafdae58]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:42.118438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'3f16f421-4b09-4db8-bb39-036024ad1e08', 'ec2a1257-8a89-482a-b313-cba09c2f2203', '503e26a7-75c9-489f-b284-76bdedd789ba'} removed Oct 23 01:00:42.204164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:00:42.204777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:42.205228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 10 from net-id = a82fecef-3e22-41fa-8192-25cadd682e03, seg-id = 390 Oct 23 01:00:42.209407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1321193f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:42.215680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2bf6,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4486}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:42.216011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:393 - treat_devices_removed completed in 0.164 Oct 23 01:00:42.216300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:393 - ports processed. Elapsed:0.190 Oct 23 01:00:42.216679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:393 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.190 Oct 23 01:00:42.901279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5b45aec2-700f-476c-9f9e-dd23998cb9b3 admin admin] Resource Port deleted: 4a7cd454-b41b-4353-a8da-dd92a4f996c1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:42.907847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5b45aec2-700f-476c-9f9e-dd23998cb9b3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (4a7cd454-b41b-4353-a8da-dd92a4f996c1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:44.027788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:394 started Oct 23 01:00:44.030695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bf8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=101000000,duration_sec=805,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:44.031448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:44.031849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:394 - starting polling. Elapsed:0.004 Oct 23 01:00:44.034842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:44.036996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port fdd89988-ac0b-48a6-9a93-d8efc80c0957 not present in bridge br-int Oct 23 01:00:44.037508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:44.041718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a7cd454-b4, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:44.053186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2bfa,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:44.053752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['fdd89988-ac0b-48a6-9a93-d8efc80c0957', '4a7cd454-b41b-4353-a8da-dd92a4f996c1'] Oct 23 01:00:44.054314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port fdd89988-ac0b-48a6-9a93-d8efc80c0957 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:44.054942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:44.105155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b52cfb4-c344-43b7-9a46-414c34a7fd7c]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:44.109807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:394 - port information retrieved. Elapsed:0.082 Oct 23 01:00:44.110210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:394 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.083 Oct 23 01:00:44.428639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["494ed58a-b60e-4657-91c4-9d2ffa63ff5b","delete","qr-4a7cd454-b4",29,["map",[["attached-mac","fa:16:3e:95:5b:14"],["iface-id","4a7cd454-b41b-4353-a8da-dd92a4f996c1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:44.810650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-51b8ba7a-7a32-4201-b092-5f3cda23c73a admin admin] Resource Port deleted: 41fed497-9616-4065-81c5-649cbe8895a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:44.811032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-51b8ba7a-7a32-4201-b092-5f3cda23c73a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (41fed497-9616-4065-81c5-649cbe8895a8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:44.934319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b531d8b5-14a6-4608-b875-9443c29325bb admin admin] Resource Port deleted: c15a8bad-19fd-46da-8328-6797a742506a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:44.934739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b531d8b5-14a6-4608-b875-9443c29325bb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (c15a8bad-19fd-46da-8328-6797a742506a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:45.253216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["67bc42f3-0436-4f67-9928-48d258a43720","delete","qg-41fed497-96",28,["map",[["attached-mac","fa:16:3e:62:f3:e3"],["iface-id","41fed497-9616-4065-81c5-649cbe8895a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:45.464918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdb5dc54-22f0-4801-a8aa-a75a43b66459 admin admin] Resource Subnet deleted: f8f208d0-6d73-485f-ba6c-97c3f7122b3d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:45.465499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdb5dc54-22f0-4801-a8aa-a75a43b66459 admin admin] Publish callbacks [] for Subnet (f8f208d0-6d73-485f-ba6c-97c3f7122b3d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:46.029481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:395 started Oct 23 01:00:46.032267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2bfc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=103000000,duration_sec=807,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:46.033275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:46.034026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:395 - starting polling. Elapsed:0.005 Oct 23 01:00:46.037582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:46.045678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c15a8bad-19, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:46.059234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2bfe,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:46.060659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['c15a8bad-19fd-46da-8328-6797a742506a'] Oct 23 01:00:46.061519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:46.144855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[78499a91-0651-42a3-afbb-c950d44b4e6e]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:46.160883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c00,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:46.164469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c02,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:46.169187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:395 - port information retrieved. Elapsed:0.136 Oct 23 01:00:46.171393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', 'f0e20492-cd09-472c-ad67-7a194ee39b4a', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '2d687c63-2eda-4404-94d4-512d1659dd28', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'c15a8bad-19fd-46da-8328-6797a742506a', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': {'4a7cd454-b41b-4353-a8da-dd92a4f996c1', '41fed497-9616-4065-81c5-649cbe8895a8'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:00:46.171972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:395 - agent port security group processed in 0.000 Oct 23 01:00:46.175212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:00:46.176196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'4a7cd454-b41b-4353-a8da-dd92a4f996c1', '41fed497-9616-4065-81c5-649cbe8895a8'} Oct 23 01:00:46.176797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 4a7cd454-b41b-4353-a8da-dd92a4f996c1 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:46.177443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:46.255970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[512127ec-4b6b-4f8f-b2a1-f8406e24f217]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:46.258590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'4a7cd454-b41b-4353-a8da-dd92a4f996c1', '41fed497-9616-4065-81c5-649cbe8895a8'} removed Oct 23 01:00:46.307999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["eeb5eb1b-8e44-4f3d-831d-ca2f0a92c686","delete","tap38b46ed1-c8",27,["map",[["attached-mac","fa:16:3e:21:6e:f1"],["iface-id","38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:46.320333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e339adec-3c75-4ed6-8340-7f5e559dfc1c admin admin] Resource Port deleted: 38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:46.321384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e339adec-3c75-4ed6-8340-7f5e559dfc1c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:46.407349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:00:46.407717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:46.408130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:395 - treat_devices_removed completed in 0.233 Oct 23 01:00:46.408414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:395 - ports processed. Elapsed:0.379 Oct 23 01:00:46.408747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:395 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.379 Oct 23 01:00:46.558502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9e74908d-1a48-4693-b1e2-b9d5d40a36ad","delete","qr-c15a8bad-19",16,["map",[["attached-mac","fa:16:3e:86:80:f4"],["iface-id","c15a8bad-19fd-46da-8328-6797a742506a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:46.690137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e339adec-3c75-4ed6-8340-7f5e559dfc1c admin admin] Resource Network deleted: 570809ed-8943-4319-88c0-71a523125321 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:46.690814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e339adec-3c75-4ed6-8340-7f5e559dfc1c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (570809ed-8943-4319-88c0-71a523125321), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:46.892075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1f6051f7-08c7-4298-a5e0-984fd5371c58 admin admin] Resource Port deleted: f0e20492-cd09-472c-ad67-7a194ee39b4a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:46.892735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1f6051f7-08c7-4298-a5e0-984fd5371c58 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (f0e20492-cd09-472c-ad67-7a194ee39b4a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.019490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Resource SecurityGroup deleted: ef20917c-8dad-4b49-8e2b-5fc4aa0568d5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.019953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (ef20917c-8dad-4b49-8e2b-5fc4aa0568d5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.020471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ef20917c-8dad-4b49-8e2b-5fc4aa0568d5',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:00:47.036876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ef20917c-8dad-4b49-8e2b-5fc4aa0568d5',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:00:47.037381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Resource SecurityGroupRule deleted: 430bf725-4787-4330-a6de-bcda8aeca4a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.037738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (430bf725-4787-4330-a6de-bcda8aeca4a8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.038077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 01:00:47.038491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Resource SecurityGroupRule deleted: 61f0c4f2-73f6-4eef-ad3d-074ece03e348 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.038833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (61f0c4f2-73f6-4eef-ad3d-074ece03e348), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.039147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 01:00:47.039748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Resource SecurityGroupRule deleted: a8d85478-02d6-443a-8bc8-124184205a5a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.040092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a8d85478-02d6-443a-8bc8-124184205a5a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.040401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 01:00:47.040798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Resource SecurityGroupRule deleted: ae95f667-901f-4aea-a5f1-170838c8d0cc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.041137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ae95f667-901f-4aea-a5f1-170838c8d0cc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.041657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5af1f2ca-bdbc-4508-9ed4-47366fdb1b47 admin admin] Security group rule updated ['ef20917c-8dad-4b49-8e2b-5fc4aa0568d5'] Oct 23 01:00:47.343341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["41a953aa-1247-43c1-8d59-84cad7121096","delete","qg-f0e20492-cd",13,["map",[["attached-mac","fa:16:3e:c5:d9:ea"],["iface-id","f0e20492-cd09-472c-ad67-7a194ee39b4a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:47.421534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f24d2f8e-3dfa-47e5-9e76-45122369d7c9 admin admin] Resource Subnet deleted: b567fc0e-81bb-4e4e-8bd3-a17fd2562f11 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.424384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f24d2f8e-3dfa-47e5-9e76-45122369d7c9 admin admin] Publish callbacks [] for Subnet (b567fc0e-81bb-4e4e-8bd3-a17fd2562f11), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.574599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["069cbcf8-f23e-4f81-b93c-c5b36a47a09b","delete","tap2d687c63-2e",8,["map",[["attached-mac","fa:16:3e:4f:02:78"],["iface-id","2d687c63-2eda-4404-94d4-512d1659dd28"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:47.620750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Resource SecurityGroup deleted: 75aeb1ed-1a22-41f7-90d4-ea7736c165c0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.621106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (75aeb1ed-1a22-41f7-90d4-ea7736c165c0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.621897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('75aeb1ed-1a22-41f7-90d4-ea7736c165c0',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:00:47.636885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('75aeb1ed-1a22-41f7-90d4-ea7736c165c0',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:00:47.637627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Resource SecurityGroupRule deleted: 60d8886c-e6bc-4d87-b075-3b3572d6404d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.638170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (60d8886c-e6bc-4d87-b075-3b3572d6404d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.638484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 01:00:47.639021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Resource SecurityGroupRule deleted: 6fd04033-887e-458c-97be-e3188f208282 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.639711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6fd04033-887e-458c-97be-e3188f208282), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.640223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 01:00:47.640874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Resource SecurityGroupRule deleted: aac5e247-dfba-4f7a-857d-ad3fc6cc0a76 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.641759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (aac5e247-dfba-4f7a-857d-ad3fc6cc0a76), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.642746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 01:00:47.643292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Resource SecurityGroupRule deleted: c72d44aa-19bb-44f3-b1ca-517c2560dde7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.643834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c72d44aa-19bb-44f3-b1ca-517c2560dde7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.644303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d79c5e01-889d-4974-9ec8-edf2eac64432 admin admin] Security group rule updated ['75aeb1ed-1a22-41f7-90d4-ea7736c165c0'] Oct 23 01:00:47.778962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c01fb19c-3b22-4c37-bf3b-7968ef5e0166 admin admin] Resource Port deleted: 2d687c63-2eda-4404-94d4-512d1659dd28 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.779622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c01fb19c-3b22-4c37-bf3b-7968ef5e0166 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (2d687c63-2eda-4404-94d4-512d1659dd28), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:47.897457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0409133d-3a7e-4edf-8c7a-ca7feeed27cc None None] Resource Port deleted: 2d687c63-2eda-4404-94d4-512d1659dd28 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:47.898028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0409133d-3a7e-4edf-8c7a-ca7feeed27cc None None] Skipped duplicate delete event for 2d687c63-2eda-4404-94d4-512d1659dd28 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:00:48.026844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c01fb19c-3b22-4c37-bf3b-7968ef5e0166 admin admin] Resource Network deleted: 1d27b6d9-fef6-49cb-833f-13cb9578958e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:48.027226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c01fb19c-3b22-4c37-bf3b-7968ef5e0166 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (1d27b6d9-fef6-49cb-833f-13cb9578958e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:48.030842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:396 started Oct 23 01:00:48.041173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=107000000,duration_sec=809,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.042158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:48.042686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:396 - starting polling. Elapsed:0.012 Oct 23 01:00:48.045097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:48.052180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c06,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.055684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c08,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.058174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c0a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.061471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c0c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.061784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:396 - port information retrieved. Elapsed:0.031 Oct 23 01:00:48.062115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': {'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'c15a8bad-19fd-46da-8328-6797a742506a', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '2d687c63-2eda-4404-94d4-512d1659dd28'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:00:48.062611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:396 - agent port security group processed in 0.000 Oct 23 01:00:48.064914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:00:48.065383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'c15a8bad-19fd-46da-8328-6797a742506a', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '2d687c63-2eda-4404-94d4-512d1659dd28'} Oct 23 01:00:48.065784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port c15a8bad-19fd-46da-8328-6797a742506a is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:00:48.066260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 12 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:48.103993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f49a9af-2ef8-4260-a4e8-1b4691bec3a5]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:48.104482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'f0e20492-cd09-472c-ad67-7a194ee39b4a', 'c15a8bad-19fd-46da-8328-6797a742506a', '38b46ed1-c8d6-4fa9-846d-3223b9ecbd7f', '2d687c63-2eda-4404-94d4-512d1659dd28'} removed Oct 23 01:00:48.188397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:00:48.188891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:00:48.189262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 11 from net-id = 570809ed-8943-4319-88c0-71a523125321, seg-id = 363 Oct 23 01:00:48.192980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x13211941,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.194897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2c0e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4459}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.195331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 6 from net-id = 1d27b6d9-fef6-49cb-833f-13cb9578958e, seg-id = 366 Oct 23 01:00:48.197827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x13211943,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.200684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2c10,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4462}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:48.201048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:396 - treat_devices_removed completed in 0.136 Oct 23 01:00:48.201959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:396 - ports processed. Elapsed:0.171 Oct 23 01:00:48.202224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:396 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 4}}. Elapsed:0.172 Oct 23 01:00:48.403954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Resource SecurityGroup deleted: b1d06491-a7a6-44ee-b7c2-32677dbd87bd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:48.404913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b1d06491-a7a6-44ee-b7c2-32677dbd87bd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:48.405374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b1d06491-a7a6-44ee-b7c2-32677dbd87bd',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:00:48.423054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b1d06491-a7a6-44ee-b7c2-32677dbd87bd',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:00:48.423598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Resource SecurityGroupRule deleted: 693c6668-97fc-44c9-9d20-4e58432d2e15 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:48.424337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (693c6668-97fc-44c9-9d20-4e58432d2e15), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:48.424866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 01:00:48.425264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Resource SecurityGroupRule deleted: 7d5d27df-a5c9-46fc-89ac-7e367a22d34e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:48.425634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7d5d27df-a5c9-46fc-89ac-7e367a22d34e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:48.426120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 01:00:48.426491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Resource SecurityGroupRule deleted: ad6634eb-6c85-4b66-9a0a-5562ded9d5d1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:48.426833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ad6634eb-6c85-4b66-9a0a-5562ded9d5d1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:48.427148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 01:00:48.427540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Resource SecurityGroupRule deleted: fb2f2c2d-ccb6-449e-9c1c-a706680256d4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:00:48.427883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fb2f2c2d-ccb6-449e-9c1c-a706680256d4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:48.428197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1c6e9fac-9d16-4ee4-b3c8-08dd51856b64 admin admin] Security group rule updated ['b1d06491-a7a6-44ee-b7c2-32677dbd87bd'] Oct 23 01:00:49.409361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:00:49Z,description='Default security group',id=9ec11291-2020-40e6-b8e0-a810898f7a4a,is_default=True,name='default',project_id='3fae115d5ad049b5b40c59212216d458',revision_number=1,rules=[SecurityGroupRule(02f25ac1-7cd3-4d08-8177-6cf9731b5141),SecurityGroupRule(0abc49cc-7041-4d60-9466-db47163e78aa),SecurityGroupRule(473ba318-5e70-43e7-b438-9296ae08da65),SecurityGroupRule(a6d41d69-0185-438f-b5ef-738e9676694d)],shared=False,stateful=True,updated_at=2022-10-23T01:00:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:49.410393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (9ec11291-2020-40e6-b8e0-a810898f7a4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:49.411004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:49Z,description=,direction='egress',ethertype='IPv4',id=02f25ac1-7cd3-4d08-8177-6cf9731b5141,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9ec11291-2020-40e6-b8e0-a810898f7a4a,updated_at=2022-10-23T01:00:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:49.411355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (02f25ac1-7cd3-4d08-8177-6cf9731b5141), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:49.411681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:00:49.412338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:49Z,description=,direction='ingress',ethertype='IPv4',id=0abc49cc-7041-4d60-9466-db47163e78aa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=9ec11291-2020-40e6-b8e0-a810898f7a4a,remote_ip_prefix=,revision_number=0,security_group_id=9ec11291-2020-40e6-b8e0-a810898f7a4a,updated_at=2022-10-23T01:00:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:49.412679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0abc49cc-7041-4d60-9466-db47163e78aa), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:49.413020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:00:49.413660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:49Z,description=,direction='ingress',ethertype='IPv6',id=473ba318-5e70-43e7-b438-9296ae08da65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=9ec11291-2020-40e6-b8e0-a810898f7a4a,remote_ip_prefix=,revision_number=0,security_group_id=9ec11291-2020-40e6-b8e0-a810898f7a4a,updated_at=2022-10-23T01:00:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:49.414125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (473ba318-5e70-43e7-b438-9296ae08da65), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:49.414446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:00:49.415145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:49Z,description=,direction='egress',ethertype='IPv6',id=a6d41d69-0185-438f-b5ef-738e9676694d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9ec11291-2020-40e6-b8e0-a810898f7a4a,updated_at=2022-10-23T01:00:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:49.415505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a6d41d69-0185-438f-b5ef-738e9676694d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:49.415816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:00:49.545001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T01:00:49Z,description='',dns_domain=None,id=fd218502-570d-4f7c-88c1-4499072d8f6e,mtu=1500,name='tempest-AttachVolumeNegativeTest-2031464467-network',project_id='3fae115d5ad049b5b40c59212216d458',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(fd218502-570d-4f7c-88c1-4499072d8f6e),segments=[NetworkSegment(e963d26c-0a32-4372-aefd-3f9403fc219c)],shared=False,status='ACTIVE',updated_at=2022-10-23T01:00:49Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:49.545382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (fd218502-570d-4f7c-88c1-4499072d8f6e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-2c525658-0eab-4773-89cf-1bfc7feab8f2 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network fd218502-570d-4f7c-88c1-4499072d8f6e with segmentation id not found. Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 01:00:49.615266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 01:00:49.616444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 01:00:49.616444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 01:00:49.616444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 01:00:49.616444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network fd218502-570d-4f7c-88c1-4499072d8f6e with segmentation id not found. Oct 23 01:00:49.616444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 01:00:49.800666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2f9e5ca4-1808-4a14-96c8-438187c5132c admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(8479922c-c008-4cda-8b88-74798066a62c)],cidr=172.20.0.0/28,created_at=2022-10-23T01:00:49Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=a9e16815-4336-4cda-ac3b-da5c9a06661d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeNegativeTest-2031464467-subnet',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,project_id='3fae115d5ad049b5b40c59212216d458',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T01:00:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:49.801064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2f9e5ca4-1808-4a14-96c8-438187c5132c admin admin] Publish callbacks [] for Subnet (a9e16815-4336-4cda-ac3b-da5c9a06661d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:50.031832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:397 started Oct 23 01:00:50.036199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=106000000,duration_sec=811,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:50.036854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:50.038199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:397 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:00:50.317575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b49781dd-446d-4caa-a0f2-4a4fe196f0d8 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:49Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-fd218502-570d-4f7c-88c1-4499072d8f6e',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8a9df9e6-1791-4258-b31e-ff476bb28ac6,mac_address=fa:16:3e:e6:7b:b0,name='',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,numa_affinity_policy=,project_id='3fae115d5ad049b5b40c59212216d458',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8a9df9e6-1791-4258-b31e-ff476bb28ac6),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:00:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:50.317944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b49781dd-446d-4caa-a0f2-4a4fe196f0d8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8a9df9e6-1791-4258-b31e-ff476bb28ac6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:50.546065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b49781dd-446d-4caa-a0f2-4a4fe196f0d8 None None] Resource Port 8a9df9e6-1791-4258-b31e-ff476bb28ac6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8a9df9e6-1791-4258-b31e-ff476bb28ac6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8a9df9e6-1791-4258-b31e-ff476bb28ac6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8a9df9e6-1791-4258-b31e-ff476bb28ac6,segment=NetworkSegment(e963d26c-0a32-4372-aefd-3f9403fc219c),segment_id=e963d26c-0a32-4372-aefd-3f9403fc219c)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:50.546737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b49781dd-446d-4caa-a0f2-4a4fe196f0d8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8a9df9e6-1791-4258-b31e-ff476bb28ac6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:50.634236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a5c605f-2cf9-4c5e-accd-9ec2624ae88b admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:50Z,data_plane_status=None,description='',device_id='8fd18b97-ffc6-453a-a42c-97191397ee01',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,mac_address=fa:16:3e:55:9b:21,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ba4c44b3-597d-4a36-9e78-c7a4635964fd),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:00:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:50.636227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a5c605f-2cf9-4c5e-accd-9ec2624ae88b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ba4c44b3-597d-4a36-9e78-c7a4635964fd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:50.648636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f64790f4-bc2e-416b-a41a-01a320308a3a","insert","tap8a9df9e6-17",["set",[]],["map",[["attached-mac","fa:16:3e:e6:7b:b0"],["iface-id","8a9df9e6-1791-4258-b31e-ff476bb28ac6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:50.665576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f64790f4-bc2e-416b-a41a-01a320308a3a","old",null,["set",[]],null],["","new","tap8a9df9e6-17",30,["map",[["attached-mac","fa:16:3e:e6:7b:b0"],["iface-id","8a9df9e6-1791-4258-b31e-ff476bb28ac6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:51.833283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-024301ec-617e-4190-8fa9-10921cc9e76a None None] Resource Port 8a9df9e6-1791-4258-b31e-ff476bb28ac6 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:51.833974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-024301ec-617e-4190-8fa9-10921cc9e76a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8a9df9e6-1791-4258-b31e-ff476bb28ac6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:52.033707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:398 started Oct 23 01:00:52.036742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=107000000,duration_sec=813,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:52.037585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:52.038114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:398 - starting polling. Elapsed:0.005 Oct 23 01:00:52.040695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:52.044543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:398 - port information retrieved. Elapsed:0.011 Oct 23 01:00:52.044967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'8a9df9e6-1791-4258-b31e-ff476bb28ac6'}, 'removed': set(), 'updated': {'8a9df9e6-1791-4258-b31e-ff476bb28ac6'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:00:52.045624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '8a9df9e6-1791-4258-b31e-ff476bb28ac6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-fd218502-570d-4f7c-88c1-4499072d8f6e', 'network_id': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'port_id': '8a9df9e6-1791-4258-b31e-ff476bb28ac6', 'mac_address': 'fa:16:3e:e6:7b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a9e16815-4336-4cda-ac3b-da5c9a06661d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:00:52.048706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 8a9df9e6-1791-4258-b31e-ff476bb28ac6 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:00:52.049143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 8a9df9e6-1791-4258-b31e-ff476bb28ac6 updated. Details: {'device': '8a9df9e6-1791-4258-b31e-ff476bb28ac6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-fd218502-570d-4f7c-88c1-4499072d8f6e', 'network_id': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'port_id': '8a9df9e6-1791-4258-b31e-ff476bb28ac6', 'mac_address': 'fa:16:3e:e6:7b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a9e16815-4336-4cda-ac3b-da5c9a06661d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 01:00:52.049549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 12 as local vlan for net-id=fd218502-570d-4f7c-88c1-4499072d8f6e, seg-id=374 Oct 23 01:00:52.053986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211945,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4470), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:52.056690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2c16,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4108)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4470}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:52.058158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a9df9e6-17, col_values=(('tag', 12),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:52.058777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8a9df9e6-17, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:52.059281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8a9df9e6-17, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:52.064686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a9df9e6-17, col_values=(('other_config', {'net_uuid': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '374'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:52.074419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c18,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:52.074986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:398 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.030 Oct 23 01:00:52.075507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 01:00:52.075981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'8a9df9e6-1791-4258-b31e-ff476bb28ac6'} Oct 23 01:00:52.077174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:00:52.077621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:00:52.082800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:52.121838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c5dd2-fdc6-4651-a753-aa1d6f35285e]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:52.122496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:398 - agent port security group processed in 0.077 Oct 23 01:00:52.123291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 8a9df9e6-1791-4258-b31e-ff476bb28ac6 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:00:52.407040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc5069af-04d9-4d74-aa4e-51743f6873ef admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:52Z,data_plane_status=None,description='',device_id='8fd18b97-ffc6-453a-a42c-97191397ee01',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=82ab6488-6b18-4ad8-b485-c6f52a5eacb2,mac_address=fa:16:3e:e3:ba:1f,name='',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,numa_affinity_policy=,project_id='3fae115d5ad049b5b40c59212216d458',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(82ab6488-6b18-4ad8-b485-c6f52a5eacb2),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:00:52Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:52.408180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bc5069af-04d9-4d74-aa4e-51743f6873ef admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (82ab6488-6b18-4ad8-b485-c6f52a5eacb2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:52.428576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['8a9df9e6-1791-4258-b31e-ff476bb28ac6'] and devices down [] completed. Oct 23 01:00:52.429200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:398 - ports processed. Elapsed:0.396 Oct 23 01:00:52.429772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:398 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.396 Oct 23 01:00:52.545887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-77eddd75-8ca2-40c6-bc24-0d84ae855e06 None None] Resource Port ba4c44b3-597d-4a36-9e78-c7a4635964fd updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:52.546518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-77eddd75-8ca2-40c6-bc24-0d84ae855e06 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ba4c44b3-597d-4a36-9e78-c7a4635964fd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:52.804338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bc5069af-04d9-4d74-aa4e-51743f6873ef admin admin] Received resource Port update without any changes: 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 01:00:52.897885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-77eddd75-8ca2-40c6-bc24-0d84ae855e06 None None] Resource Port ba4c44b3-597d-4a36-9e78-c7a4635964fd updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:52.898531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-77eddd75-8ca2-40c6-bc24-0d84ae855e06 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ba4c44b3-597d-4a36-9e78-c7a4635964fd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:53.422134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["352ba784-1654-4b15-bd2e-61d84303f86d","insert","qr-82ab6488-6b",["set",[]],["map",[["attached-mac","fa:16:3e:e3:ba:1f"],["iface-id","82ab6488-6b18-4ad8-b485-c6f52a5eacb2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:53.441656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["352ba784-1654-4b15-bd2e-61d84303f86d","old",null,["set",[]],null],["","new","qr-82ab6488-6b",31,["map",[["attached-mac","fa:16:3e:e3:ba:1f"],["iface-id","82ab6488-6b18-4ad8-b485-c6f52a5eacb2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:53.603025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:00:53Z,description='tempest-description--405554673',id=60dd1184-0af4-4724-85fc-d8387f89088a,is_default=False,name='tempest-securitygroup--1974425875',project_id='3fae115d5ad049b5b40c59212216d458',revision_number=1,rules=[SecurityGroupRule(d609b42e-6fe1-4278-a112-c3e5edf23fc2),SecurityGroupRule(f3394cad-42d7-4c5f-9f22-cf0a515d2062)],shared=False,stateful=True,updated_at=2022-10-23T01:00:53Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:53.603643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (60dd1184-0af4-4724-85fc-d8387f89088a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:53.604969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:53Z,description=,direction='egress',ethertype='IPv4',id=d609b42e-6fe1-4278-a112-c3e5edf23fc2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=60dd1184-0af4-4724-85fc-d8387f89088a,updated_at=2022-10-23T01:00:53Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:53.605922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d609b42e-6fe1-4278-a112-c3e5edf23fc2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:53.606508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:00:53.608171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:53Z,description=,direction='egress',ethertype='IPv6',id=f3394cad-42d7-4c5f-9f22-cf0a515d2062,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=60dd1184-0af4-4724-85fc-d8387f89088a,updated_at=2022-10-23T01:00:53Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:53.609694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f3394cad-42d7-4c5f-9f22-cf0a515d2062), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:53.609878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-60294a6a-bb40-4e91-8d5b-d8c0976be643 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:00:53.731611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc3c45ed-0447-4b02-9d10-700692e4a8a5 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:53Z,description='',direction='ingress',ethertype='IPv4',id=0d7c024c-17cc-4722-95ae-ff1584b14385,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='3fae115d5ad049b5b40c59212216d458',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=60dd1184-0af4-4724-85fc-d8387f89088a,updated_at=2022-10-23T01:00:53Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:53.732182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc3c45ed-0447-4b02-9d10-700692e4a8a5 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0d7c024c-17cc-4722-95ae-ff1584b14385), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:53.732777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-dc3c45ed-0447-4b02-9d10-700692e4a8a5 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:00:53.869358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-62829780-05f5-4669-9cf9-099aa7a8b794 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:00:53Z,description='',direction='ingress',ethertype='IPv4',id=5b5fa101-2c7a-48db-985c-69ede5d0c04c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=60dd1184-0af4-4724-85fc-d8387f89088a,updated_at=2022-10-23T01:00:53Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:53.869358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-62829780-05f5-4669-9cf9-099aa7a8b794 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5b5fa101-2c7a-48db-985c-69ede5d0c04c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:53.869358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-62829780-05f5-4669-9cf9-099aa7a8b794 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:00:53.876129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["10ee2916-7a08-4df8-be64-0558ff010e35","insert","qg-ba4c44b3-59",["set",[]],["map",[["attached-mac","fa:16:3e:55:9b:21"],["iface-id","ba4c44b3-597d-4a36-9e78-c7a4635964fd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:53.897155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["10ee2916-7a08-4df8-be64-0558ff010e35","old",null,["set",[]],null],["","new","qg-ba4c44b3-59",32,["map",[["attached-mac","fa:16:3e:55:9b:21"],["iface-id","ba4c44b3-597d-4a36-9e78-c7a4635964fd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:00:54.034667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:399 started Oct 23 01:00:54.037275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=108000000,duration_sec=815,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:54.037867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:54.038415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:399 - starting polling. Elapsed:0.004 Oct 23 01:00:54.041139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:54.045040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:399 - port information retrieved. Elapsed:0.011 Oct 23 01:00:54.045375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd'}, 'removed': set(), 'updated': {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:00:54.046038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:52Z,data_plane_status=None,description='',device_id='8fd18b97-ffc6-453a-a42c-97191397ee01',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=82ab6488-6b18-4ad8-b485-c6f52a5eacb2,mac_address=fa:16:3e:e3:ba:1f,name='',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,numa_affinity_policy=,project_id='3fae115d5ad049b5b40c59212216d458',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(82ab6488-6b18-4ad8-b485-c6f52a5eacb2),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:00:52Z) is not bound. Oct 23 01:00:54.046591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'mac_address': 'fa:16:3e:55:9b:21', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:00:54.049998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:00:54.050287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Device 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 not defined on plugin or binding failed Oct 23 01:00:54.050762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: ba4c44b3-597d-4a36-9e78-c7a4635964fd {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:00:54.051084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port ba4c44b3-597d-4a36-9e78-c7a4635964fd updated. Details: {'device': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'mac_address': 'fa:16:3e:55:9b:21', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 01:00:54.052188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba4c44b3-59, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:54.052617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ba4c44b3-59, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:54.053079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ba4c44b3-59, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:54.062664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba4c44b3-59, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:54.072122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c1c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:54.072577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:399 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.027 Oct 23 01:00:54.073042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 2 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 01:00:54.073397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd'} Oct 23 01:00:54.075256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:00:54.075737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:00:54.080399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:54.124122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e48ef41-86cb-47fa-a5b2-b27b208e8b21]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:54.125096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:399 - agent port security group processed in 0.079 Oct 23 01:00:54.125905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for ba4c44b3-597d-4a36-9e78-c7a4635964fd to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:00:54.292253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['ba4c44b3-597d-4a36-9e78-c7a4635964fd'] and devices down [] completed. Oct 23 01:00:54.292851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:399 - ports processed. Elapsed:0.258 Oct 23 01:00:54.293529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:399 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:0.259 Oct 23 01:00:54.355395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port ba4c44b3-597d-4a36-9e78-c7a4635964fd updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ba4c44b3-597d-4a36-9e78-c7a4635964fd,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:54.356089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ba4c44b3-597d-4a36-9e78-c7a4635964fd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:54.372345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2018239e-ccc7-4af8-8dbf-19169d5462e9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:54Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8bed982c-09ac-4308-8015-c166586e609c,mac_address=fa:16:3e:52:84:78,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8bed982c-09ac-4308-8015-c166586e609c),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:00:54Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:54.372758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2018239e-ccc7-4af8-8dbf-19169d5462e9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8bed982c-09ac-4308-8015-c166586e609c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:54.739042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2018239e-ccc7-4af8-8dbf-19169d5462e9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port 8bed982c-09ac-4308-8015-c166586e609c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'ae4e723b-0c0d-4bab-9a58-dc2a97d6c0ef'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:54.739677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2018239e-ccc7-4af8-8dbf-19169d5462e9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (8bed982c-09ac-4308-8015-c166586e609c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:56.035633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:400 started Oct 23 01:00:56.038330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=109000000,duration_sec=817,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:56.038900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:56.039319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:400 - starting polling. Elapsed:0.004 Oct 23 01:00:56.042082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:56.045747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:400 - port information retrieved. Elapsed:0.010 Oct 23 01:00:56.046061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'ba4c44b3-597d-4a36-9e78-c7a4635964fd'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:00:56.046942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'mac_address': 'fa:16:3e:55:9b:21', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:00:56.050398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: ba4c44b3-597d-4a36-9e78-c7a4635964fd {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:00:56.050726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port ba4c44b3-597d-4a36-9e78-c7a4635964fd updated. Details: {'device': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', 'mac_address': 'fa:16:3e:55:9b:21', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 01:00:56.051862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba4c44b3-59, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:56.052448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ba4c44b3-59, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:56.052867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ba4c44b3-59, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:56.053338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:00:56.054090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba4c44b3-59, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:56.054726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:00:56.057961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c20,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:56.058351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:400 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.012 Oct 23 01:00:56.058705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 01:00:56.058988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 01:00:56.060320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:00:56.060601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:00:56.065072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:56.085266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0bf2e3aa-8249-481a-9bc8-3b2b4382cbf3 None None] Resource Port 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=82ab6488-6b18-4ad8-b485-c6f52a5eacb2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=82ab6488-6b18-4ad8-b485-c6f52a5eacb2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:56.086739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0bf2e3aa-8249-481a-9bc8-3b2b4382cbf3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (82ab6488-6b18-4ad8-b485-c6f52a5eacb2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:56.133195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94882f0-9fb9-4ebf-b978-4bc480381b2f]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:56.133937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:400 - agent port security group processed in 0.087 Oct 23 01:00:56.134836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for ba4c44b3-597d-4a36-9e78-c7a4635964fd to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:00:56.274828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['ba4c44b3-597d-4a36-9e78-c7a4635964fd'] and devices down [] completed. Oct 23 01:00:56.275244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:400 - ports processed. Elapsed:0.240 Oct 23 01:00:56.275654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:400 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.240 Oct 23 01:00:56.323945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0bf2e3aa-8249-481a-9bc8-3b2b4382cbf3 None None] Resource Port 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=82ab6488-6b18-4ad8-b485-c6f52a5eacb2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=82ab6488-6b18-4ad8-b485-c6f52a5eacb2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=82ab6488-6b18-4ad8-b485-c6f52a5eacb2,segment=NetworkSegment(e963d26c-0a32-4372-aefd-3f9403fc219c),segment_id=e963d26c-0a32-4372-aefd-3f9403fc219c)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:56.324351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0bf2e3aa-8249-481a-9bc8-3b2b4382cbf3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (82ab6488-6b18-4ad8-b485-c6f52a5eacb2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:57.695484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8dbd8a64-b4e1-45c7-af13-9b2992a890ff tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:00:57Z,data_plane_status=None,description='',device_id='9cb40f6d-56d7-4fd3-b7ec-29a34218367d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2eafe9f3-8116-4c7f-a6ed-69810adb3007,mac_address=fa:16:3e:70:0a:f9,name='',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,numa_affinity_policy=,project_id='3fae115d5ad049b5b40c59212216d458',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2eafe9f3-8116-4c7f-a6ed-69810adb3007),security_group_ids=set([60dd1184-0af4-4724-85fc-d8387f89088a]),status='DOWN',updated_at=2022-10-23T01:00:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:00:57.696163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8dbd8a64-b4e1-45c7-af13-9b2992a890ff tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2eafe9f3-8116-4c7f-a6ed-69810adb3007), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:57.696786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8dbd8a64-b4e1-45c7-af13-9b2992a890ff tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'60dd1184-0af4-4724-85fc-d8387f89088a'} Oct 23 01:00:58.036789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:401 started Oct 23 01:00:58.039459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=110000000,duration_sec=819,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:58.040129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:00:58.040540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:401 - starting polling. Elapsed:0.004 Oct 23 01:00:58.043614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:58.047386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:401 - port information retrieved. Elapsed:0.011 Oct 23 01:00:58.047790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:00:58.048437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'port_id': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'mac_address': 'fa:16:3e:e3:ba:1f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a9e16815-4336-4cda-ac3b-da5c9a06661d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:00:58.051902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:00:58.052298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 updated. Details: {'device': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'port_id': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'mac_address': 'fa:16:3e:e3:ba:1f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a9e16815-4336-4cda-ac3b-da5c9a06661d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 23 01:00:58.053418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-82ab6488-6b, col_values=(('tag', 12),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:58.053847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-82ab6488-6b, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:58.054287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-82ab6488-6b, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:58.059851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-82ab6488-6b, col_values=(('other_config', {'net_uuid': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '374'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:00:58.067092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c24,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:00:58.067438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:401 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.019 Oct 23 01:00:58.067808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 01:00:58.068098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 01:00:58.069318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:00:58.069588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:00:58.074479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:00:58.112105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1fd9cf-c700-42fd-823d-5e68eea0ec16]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:00:58.112663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:401 - agent port security group processed in 0.064 Oct 23 01:00:58.113535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:00:58.293468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['82ab6488-6b18-4ad8-b485-c6f52a5eacb2'] and devices down [] completed. Oct 23 01:00:58.294348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:401 - ports processed. Elapsed:0.257 Oct 23 01:00:58.296343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:401 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.258 Oct 23 01:00:58.348779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:58.349162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (82ab6488-6b18-4ad8-b485-c6f52a5eacb2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:58.522793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-88d49ed9-4c96-4b21-ad20-a8268bc632b1 service neutron] Resource Port 2eafe9f3-8116-4c7f-a6ed-69810adb3007 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=2eafe9f3-8116-4c7f-a6ed-69810adb3007,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2eafe9f3-8116-4c7f-a6ed-69810adb3007,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:58.523177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-88d49ed9-4c96-4b21-ad20-a8268bc632b1 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2eafe9f3-8116-4c7f-a6ed-69810adb3007), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:00:58.811362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-88d49ed9-4c96-4b21-ad20-a8268bc632b1 service neutron] Resource Port 2eafe9f3-8116-4c7f-a6ed-69810adb3007 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2eafe9f3-8116-4c7f-a6ed-69810adb3007,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2eafe9f3-8116-4c7f-a6ed-69810adb3007,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2eafe9f3-8116-4c7f-a6ed-69810adb3007,segment=NetworkSegment(e963d26c-0a32-4372-aefd-3f9403fc219c),segment_id=e963d26c-0a32-4372-aefd-3f9403fc219c)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:00:58.812003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-88d49ed9-4c96-4b21-ad20-a8268bc632b1 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2eafe9f3-8116-4c7f-a6ed-69810adb3007), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:00.039941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:402 started Oct 23 01:01:00.044451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=114000000,duration_sec=821,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:00.045374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:00.045882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:402 - starting polling. Elapsed:0.006 Oct 23 01:01:00.050127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:00.056390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:402 - port information retrieved. Elapsed:0.017 Oct 23 01:01:00.056831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': set(), 'updated': {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:01:00.058199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'port_id': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'mac_address': 'fa:16:3e:e3:ba:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a9e16815-4336-4cda-ac3b-da5c9a06661d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:01:00.061534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:01:00.061898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 updated. Details: {'device': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'device_id': '8fd18b97-ffc6-453a-a42c-97191397ee01', 'network_id': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'port_id': '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', 'mac_address': 'fa:16:3e:e3:ba:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a9e16815-4336-4cda-ac3b-da5c9a06661d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 23 01:01:00.062928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-82ab6488-6b, col_values=(('tag', 12),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:01:00.063386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-82ab6488-6b, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:01:00.063784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-82ab6488-6b, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:01:00.064232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:01:00.065353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-82ab6488-6b, col_values=(('other_config', {'net_uuid': 'fd218502-570d-4f7c-88c1-4499072d8f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '374', 'tag': '12'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:01:00.066026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:01:00.068246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c28,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:00.068710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:402 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.011 Oct 23 01:01:00.069088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 01:01:00.069377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 01:01:00.070509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:01:00.070793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:01:00.075466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:01:00.113679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e2634-af43-4a26-959f-6fa7ca607344]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:01:00.114499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:402 - agent port security group processed in 0.057 Oct 23 01:01:00.115702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:01:00.247230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['82ab6488-6b18-4ad8-b485-c6f52a5eacb2'] and devices down [] completed. Oct 23 01:01:00.247547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:402 - ports processed. Elapsed:0.208 Oct 23 01:01:00.247882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:402 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.208 Oct 23 01:01:02.041120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:403 started Oct 23 01:01:02.043812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=114000000,duration_sec=823,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:02.044394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:02.044849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:403 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:02.233902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 2eafe9f3-8116-4c7f-a6ed-69810adb3007 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:01:02.234417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2eafe9f3-8116-4c7f-a6ed-69810adb3007), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:04.041677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:404 started Oct 23 01:01:04.044552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=115000000,duration_sec=825,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:04.045339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:04.045674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:404 - starting polling. Elapsed:0.004 Oct 23 01:01:04.048340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:04.051881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:404 - port information retrieved. Elapsed:0.010 Oct 23 01:01:04.052448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:404 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:01:04.238183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 2eafe9f3-8116-4c7f-a6ed-69810adb3007 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:01:04.238816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2eafe9f3-8116-4c7f-a6ed-69810adb3007), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:06.043418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:405 started Oct 23 01:01:06.046315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=117000000,duration_sec=827,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:06.047052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:06.047450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:405 - starting polling. Elapsed:0.005 Oct 23 01:01:06.050456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:06.054351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:405 - port information retrieved. Elapsed:0.012 Oct 23 01:01:06.054793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:405 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 01:01:08.044602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:406 started Oct 23 01:01:08.047446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=118000000,duration_sec=829,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:08.048029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:08.048384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:406 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:10.045599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:407 started Oct 23 01:01:10.049491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=119000000,duration_sec=831,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:10.050438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:10.051243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:407 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:01:12.047254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:408 started Oct 23 01:01:12.051370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=122000000,duration_sec=833,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:12.052222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:12.052709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:408 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:01:14.048260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:409 started Oct 23 01:01:14.051823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=122000000,duration_sec=835,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:14.052489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:14.052918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:409 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:01:16.049451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:410 started Oct 23 01:01:16.053542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=123000000,duration_sec=837,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:16.054219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:16.054649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:410 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:01:18.050862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:411 started Oct 23 01:01:18.055167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=125000000,duration_sec=839,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:18.056783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:18.057445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:411 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:01:20.051131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:412 started Oct 23 01:01:20.055666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=125000000,duration_sec=841,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:20.056607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:20.057259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:412 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:01:22.052237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:413 started Oct 23 01:01:22.064326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=126000000,duration_sec=843,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:22.065970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:22.066535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:413 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 23 01:01:24.052539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:414 started Oct 23 01:01:24.055238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=126000000,duration_sec=845,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:24.055846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:24.056204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:414 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:24.289776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:01:24.290479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:26.062956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:415 started Oct 23 01:01:26.073131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=143000000,duration_sec=847,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:26.074388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:26.075009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:415 - starting polling. Elapsed:0.021 Oct 23 01:01:26.084859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:26.093463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:415 - port information retrieved. Elapsed:0.039 Oct 23 01:01:26.093809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:415 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.040 Oct 23 01:01:26.458814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:01:26.459293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:28.058373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:416 started Oct 23 01:01:28.060854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=132000000,duration_sec=849,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:28.061430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:28.061804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:416 - starting polling. Elapsed:0.004 Oct 23 01:01:28.064938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:28.068425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:416 - port information retrieved. Elapsed:0.010 Oct 23 01:01:28.068768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:416 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:01:30.059945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:417 started Oct 23 01:01:30.062310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=133000000,duration_sec=851,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:30.062922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:30.063278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:417 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:32.060453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:418 started Oct 23 01:01:32.064580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=135000000,duration_sec=853,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:32.065205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:32.066194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:418 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:01:34.061877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:419 started Oct 23 01:01:34.064913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=135000000,duration_sec=855,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:34.065463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:34.065808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:419 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:36.062482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:420 started Oct 23 01:01:36.065162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=136000000,duration_sec=857,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:36.065817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:36.066229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:420 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:38.064006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:421 started Oct 23 01:01:38.066864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=137000000,duration_sec=859,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:38.067667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:38.068183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:421 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:38.261108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:01:38.261483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:40.065047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:422 started Oct 23 01:01:40.067686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=138000000,duration_sec=861,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:40.068280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:40.068620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:422 - starting polling. Elapsed:0.004 Oct 23 01:01:40.071314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:40.075267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:422 - port information retrieved. Elapsed:0.010 Oct 23 01:01:40.075687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:422 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:01:41.258025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-82df48e9-0cae-4973-96fb-9729c86d09af tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource Port deleted: 752bf309-e01c-493c-aa69-b31be007e882 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:41.258612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-82df48e9-0cae-4973-96fb-9729c86d09af tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (752bf309-e01c-493c-aa69-b31be007e882), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:41.258829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-82df48e9-0cae-4973-96fb-9729c86d09af tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group member updated {'99b637e5-7b4a-4535-a0f5-900744a58770'} Oct 23 01:01:42.066050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:423 started Oct 23 01:01:42.068402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=139000000,duration_sec=863,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:42.069013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:42.069348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:423 - starting polling. Elapsed:0.003 Oct 23 01:01:42.071994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:42.073868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 752bf309-e01c-493c-aa69-b31be007e882 not present in bridge br-int Oct 23 01:01:42.074207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:01:42.074514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['752bf309-e01c-493c-aa69-b31be007e882'] Oct 23 01:01:42.074839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 752bf309-e01c-493c-aa69-b31be007e882 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:01:42.081167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:423 - port information retrieved. Elapsed:0.015 Oct 23 01:01:42.081789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:423 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 23 01:01:44.067597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:424 started Oct 23 01:01:44.070392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=141000000,duration_sec=865,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:44.070970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:44.071319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:424 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:46.068899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:425 started Oct 23 01:01:46.071500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=142000000,duration_sec=867,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:46.072368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:46.072754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:425 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:48.070057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:426 started Oct 23 01:01:48.072557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=143000000,duration_sec=869,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:48.073165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:48.073515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:426 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:50.071396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:427 started Oct 23 01:01:50.073997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=145000000,duration_sec=871,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:50.074578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:50.074929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:427 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:51.857255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroup deleted: 99b637e5-7b4a-4535-a0f5-900744a58770 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:51.857941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (99b637e5-7b4a-4535-a0f5-900744a58770), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:51.858059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('99b637e5-7b4a-4535-a0f5-900744a58770',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:01:51.871601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('99b637e5-7b4a-4535-a0f5-900744a58770',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:01:51.872096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: 0e2ec046-e1de-4966-a905-9eedc247f6d4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:51.872473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0e2ec046-e1de-4966-a905-9eedc247f6d4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:51.872779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:01:51.873187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: f4adcb1b-044d-41b2-841a-0e4f45ffa365 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:51.873523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f4adcb1b-044d-41b2-841a-0e4f45ffa365), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:51.873831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:01:51.874191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: 5e7676d6-9e1a-44d8-a463-f30f823c2f74 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:51.874520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5e7676d6-9e1a-44d8-a463-f30f823c2f74), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:51.874825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:01:51.875187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource SecurityGroupRule deleted: 90652faf-d6a1-42f9-aa7f-9438e30e150a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:51.875512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (90652faf-d6a1-42f9-aa7f-9438e30e150a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:51.875814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b44db5b3-3526-4698-b73c-1a7a9ab764ae tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Security group rule updated ['99b637e5-7b4a-4535-a0f5-900744a58770'] Oct 23 01:01:52.072227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:428 started Oct 23 01:01:52.074874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=146000000,duration_sec=873,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:52.075467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:52.075824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:428 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:01:52.252174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a51d5c1c-ed07-4d87-9bc3-bed4c4a1db6d tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Resource Port deleted: 76e0a054-229e-4284-83a4-cb25bcb1c471 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:52.252860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a51d5c1c-ed07-4d87-9bc3-bed4c4a1db6d tempest-AttachVolumeTestJSON-1158760126 tempest-AttachVolumeTestJSON-1158760126-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (76e0a054-229e-4284-83a4-cb25bcb1c471), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:54.072652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:429 started Oct 23 01:01:54.075534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=146000000,duration_sec=875,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:54.076213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:54.076614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:429 - starting polling. Elapsed:0.004 Oct 23 01:01:54.079301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:54.081196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 76e0a054-229e-4284-83a4-cb25bcb1c471 not present in bridge br-int Oct 23 01:01:54.081536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:01:54.081846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['76e0a054-229e-4284-83a4-cb25bcb1c471'] Oct 23 01:01:54.082195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 76e0a054-229e-4284-83a4-cb25bcb1c471 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:01:54.085940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:429 - port information retrieved. Elapsed:0.013 Oct 23 01:01:54.086276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:429 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 01:01:54.427141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:01:54.427538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:56.073983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:430 started Oct 23 01:01:56.077293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=148000000,duration_sec=877,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:56.077896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:56.078228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:430 - starting polling. Elapsed:0.004 Oct 23 01:01:56.080826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:56.084549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:430 - port information retrieved. Elapsed:0.011 Oct 23 01:01:56.084905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:430 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:01:56.419143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:01:56.419749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:56.947585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-78d44686-f44d-4899-b23f-d24f99668f45 admin admin] Resource Port deleted: 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:56.948063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-78d44686-f44d-4899-b23f-d24f99668f45 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:58.075352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:431 started Oct 23 01:01:58.079408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=150000000,duration_sec=879,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:58.079979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:01:58.080311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:431 - starting polling. Elapsed:0.005 Oct 23 01:01:58.083063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:58.087485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9b1d8b2e-51, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:01:58.099893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c64,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:01:58.100402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'] Oct 23 01:01:58.100891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:01:58.160619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecbc8a1-daed-420b-82fa-f198b1f907d2]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:01:58.165050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:431 - port information retrieved. Elapsed:0.090 Oct 23 01:01:58.165714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:431 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.090 Oct 23 01:01:58.265899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["86caff51-aeca-4041-9529-2c67dbe4ccee","delete","qr-9b1d8b2e-51",11,["map",[["attached-mac","fa:16:3e:fd:54:c7"],["iface-id","9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:01:58.332671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2437b333-6660-436a-904e-eef9135d4045 admin admin] Resource Port deleted: e10e1214-c988-4645-bc00-e42d4d9a7e6b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:58.333201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2437b333-6660-436a-904e-eef9135d4045 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (e10e1214-c988-4645-bc00-e42d4d9a7e6b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:58.661012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1d596505-5362-4673-8635-02584d2dda84","delete","qg-e10e1214-c9",12,["map",[["attached-mac","fa:16:3e:7a:80:7c"],["iface-id","e10e1214-c988-4645-bc00-e42d4d9a7e6b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:01:58.816428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a264e5d7-04b9-41ca-8389-d6c13c40671a admin admin] Resource Subnet deleted: bdebfcdc-6951-4fee-aa37-29ecb806813d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:58.816818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a264e5d7-04b9-41ca-8389-d6c13c40671a admin admin] Publish callbacks [] for Subnet (bdebfcdc-6951-4fee-aa37-29ecb806813d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:58.981502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["70a97d35-69da-4b55-9073-557c9eedbfb6","delete","tapfe0c83f1-a5",9,["map",[["attached-mac","fa:16:3e:35:08:26"],["iface-id","fe0c83f1-a5c5-47bb-a91f-c709bd53e220"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:01:59.197883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f68244b5-2d33-4558-bc92-dcb0e1050d09 admin admin] Resource Port deleted: fe0c83f1-a5c5-47bb-a91f-c709bd53e220 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.199895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f68244b5-2d33-4558-bc92-dcb0e1050d09 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (fe0c83f1-a5c5-47bb-a91f-c709bd53e220), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.279259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f87835c-acdd-4bd0-b701-c51540c67184 None None] Resource Port deleted: fe0c83f1-a5c5-47bb-a91f-c709bd53e220 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.279539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9f87835c-acdd-4bd0-b701-c51540c67184 None None] Skipped duplicate delete event for fe0c83f1-a5c5-47bb-a91f-c709bd53e220 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:01:59.324006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:01:59Z,description='tempest-description--1724671704',id=27fe5e11-7bd5-432e-9b1b-087e3e2991c9,is_default=False,name='tempest-securitygroup--1068154258',project_id='3fae115d5ad049b5b40c59212216d458',revision_number=1,rules=[SecurityGroupRule(3b73bb2c-52b9-4bc1-a8f2-6243d1585a0a),SecurityGroupRule(eb2a0f1b-a504-4a91-a8be-7234a02e7f30)],shared=False,stateful=True,updated_at=2022-10-23T01:01:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:01:59.324411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (27fe5e11-7bd5-432e-9b1b-087e3e2991c9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.325384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:01:59Z,description=,direction='egress',ethertype='IPv4',id=3b73bb2c-52b9-4bc1-a8f2-6243d1585a0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=27fe5e11-7bd5-432e-9b1b-087e3e2991c9,updated_at=2022-10-23T01:01:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:01:59.325746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3b73bb2c-52b9-4bc1-a8f2-6243d1585a0a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.326083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:01:59.326754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:01:59Z,description=,direction='egress',ethertype='IPv6',id=eb2a0f1b-a504-4a91-a8be-7234a02e7f30,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=27fe5e11-7bd5-432e-9b1b-087e3e2991c9,updated_at=2022-10-23T01:01:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:01:59.327103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (eb2a0f1b-a504-4a91-a8be-7234a02e7f30), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.327429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a2257b6b-328a-4aaf-a7b5-49cd85d7dd65 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:01:59.524518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f68244b5-2d33-4558-bc92-dcb0e1050d09 admin admin] Resource Network deleted: 6e24fc8d-42d5-4d11-b06b-37a4738231b0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.524916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f68244b5-2d33-4558-bc92-dcb0e1050d09 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (6e24fc8d-42d5-4d11-b06b-37a4738231b0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.557130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2f9bfca7-3a6b-4cd0-b742-86c2d5b13cfc tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:01:59Z,description='',direction='ingress',ethertype='IPv4',id=60c9787b-1fcb-45e7-bd57-9e4dbb3ea36b,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='3fae115d5ad049b5b40c59212216d458',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=27fe5e11-7bd5-432e-9b1b-087e3e2991c9,updated_at=2022-10-23T01:01:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:01:59.557956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2f9bfca7-3a6b-4cd0-b742-86c2d5b13cfc tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (60c9787b-1fcb-45e7-bd57-9e4dbb3ea36b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.558308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2f9bfca7-3a6b-4cd0-b742-86c2d5b13cfc tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:01:59.685974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e54acd12-ecef-4cb9-ad67-bd87f6b330c5 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:01:59Z,description='',direction='ingress',ethertype='IPv4',id=1e4592bf-1cba-4878-951e-5284e397eaf0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=27fe5e11-7bd5-432e-9b1b-087e3e2991c9,updated_at=2022-10-23T01:01:59Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:01:59.686672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e54acd12-ecef-4cb9-ad67-bd87f6b330c5 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1e4592bf-1cba-4878-951e-5284e397eaf0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.687013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e54acd12-ecef-4cb9-ad67-bd87f6b330c5 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:01:59.973560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Resource SecurityGroup deleted: cb50e658-4e19-4f1f-805f-093dd827acaf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.974091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (cb50e658-4e19-4f1f-805f-093dd827acaf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.974610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cb50e658-4e19-4f1f-805f-093dd827acaf',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:01:59.987885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cb50e658-4e19-4f1f-805f-093dd827acaf',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:01:59.988620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Resource SecurityGroupRule deleted: 1e75bc3f-4777-43a2-8855-8a48add3aac2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.989017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1e75bc3f-4777-43a2-8855-8a48add3aac2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.989350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 01:01:59.989986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Resource SecurityGroupRule deleted: 57023bc4-30c2-48e4-9581-cbb190570b07 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.990362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (57023bc4-30c2-48e4-9581-cbb190570b07), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.990852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 01:01:59.991396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Resource SecurityGroupRule deleted: aa8520f3-b8f3-46c2-8726-a31d0f33e4d6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.992113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (aa8520f3-b8f3-46c2-8726-a31d0f33e4d6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.992113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 01:01:59.992387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Resource SecurityGroupRule deleted: b449bf2a-5d76-4337-89f2-997f28858ff2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:01:59.992895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b449bf2a-5d76-4337-89f2-997f28858ff2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:01:59.993403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-30d05d24-2fcd-4d39-aedd-8acfa50cd6a5 admin admin] Security group rule updated ['cb50e658-4e19-4f1f-805f-093dd827acaf'] Oct 23 01:02:00.076964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:432 started Oct 23 01:02:00.079840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=151000000,duration_sec=881,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:00.080606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:00.081275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:432 - starting polling. Elapsed:0.005 Oct 23 01:02:00.083863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:00.089583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c68,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:00.091292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c6a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:00.093628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c6c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:00.093909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:432 - port information retrieved. Elapsed:0.017 Oct 23 01:02:00.094397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'02ea638b-e76a-43d4-a7af-3b5be374e752', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '045e8cb5-b097-4c96-a318-d42be89b2e6f', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': {'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:02:00.094727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:432 - agent port security group processed in 0.000 Oct 23 01:02:00.097611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:02:00.098046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'} Oct 23 01:02:00.098564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:02:00.098990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:02:00.152211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[183830f1-f757-43d9-92bc-4e342c9192c3]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:02:00.153079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'e10e1214-c988-4645-bc00-e42d4d9a7e6b', 'fe0c83f1-a5c5-47bb-a91f-c709bd53e220', '9b1d8b2e-5105-4e6a-bb64-7cc5a3c2739a'} removed Oct 23 01:02:00.223588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8596fc8f-b310-4cbf-b449-e2afac1e65f9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:01:59Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=637b8626-323a-4d8d-a79d-6d498a70cc01,mac_address=fa:16:3e:08:e2:2f,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(637b8626-323a-4d8d-a79d-6d498a70cc01),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:02:00Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:00.224834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8596fc8f-b310-4cbf-b449-e2afac1e65f9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (637b8626-323a-4d8d-a79d-6d498a70cc01), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:00.230545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:02:00.230881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 7 from net-id = 6e24fc8d-42d5-4d11-b06b-37a4738231b0, seg-id = 399 Oct 23 01:02:00.233915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x13211947,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:00.240212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2c6e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4495}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:00.240524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:02:00.241007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:432 - treat_devices_removed completed in 0.143 Oct 23 01:02:00.241499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:432 - ports processed. Elapsed:0.165 Oct 23 01:02:00.241789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:432 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.165 Oct 23 01:02:00.604448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8596fc8f-b310-4cbf-b449-e2afac1e65f9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port 637b8626-323a-4d8d-a79d-6d498a70cc01 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'd84ffc9e-a979-455d-a4f4-f4b8ba74ad31'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:00.606062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8596fc8f-b310-4cbf-b449-e2afac1e65f9 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (637b8626-323a-4d8d-a79d-6d498a70cc01), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:02.078318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:433 started Oct 23 01:02:02.081221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=152000000,duration_sec=883,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:02.081794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:02.082147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:433 - starting polling. Elapsed:0.004 Oct 23 01:02:02.084631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:02.088010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:433 - port information retrieved. Elapsed:0.010 Oct 23 01:02:02.088345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:433 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:02:03.245432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7405f44e-273d-4939-92c9-c078e2c9a499 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:02:02Z,data_plane_status=None,description='',device_id='7979ba1d-67a3-4380-8cc9-e65ed6e50cd5',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e718bd05-4ddf-4ebd-b9d8-a8876d827df4,mac_address=fa:16:3e:93:f8:70,name='',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,numa_affinity_policy=,project_id='3fae115d5ad049b5b40c59212216d458',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e718bd05-4ddf-4ebd-b9d8-a8876d827df4),security_group_ids=set([27fe5e11-7bd5-432e-9b1b-087e3e2991c9]),status='DOWN',updated_at=2022-10-23T01:02:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:03.246146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7405f44e-273d-4939-92c9-c078e2c9a499 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e718bd05-4ddf-4ebd-b9d8-a8876d827df4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:03.247089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7405f44e-273d-4939-92c9-c078e2c9a499 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'27fe5e11-7bd5-432e-9b1b-087e3e2991c9'} Oct 23 01:02:03.803959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-35c97452-4ede-4316-b399-49073dad69d7 service neutron] Resource Port e718bd05-4ddf-4ebd-b9d8-a8876d827df4 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=e718bd05-4ddf-4ebd-b9d8-a8876d827df4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e718bd05-4ddf-4ebd-b9d8-a8876d827df4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:03.804638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-35c97452-4ede-4316-b399-49073dad69d7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e718bd05-4ddf-4ebd-b9d8-a8876d827df4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:04.078752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:434 started Oct 23 01:02:04.081983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=152000000,duration_sec=885,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:04.082621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:04.082953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:434 - starting polling. Elapsed:0.004 Oct 23 01:02:04.085516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:04.088770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:434 - port information retrieved. Elapsed:0.010 Oct 23 01:02:04.089165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:434 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:02:04.124908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-35c97452-4ede-4316-b399-49073dad69d7 service neutron] Resource Port e718bd05-4ddf-4ebd-b9d8-a8876d827df4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e718bd05-4ddf-4ebd-b9d8-a8876d827df4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e718bd05-4ddf-4ebd-b9d8-a8876d827df4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e718bd05-4ddf-4ebd-b9d8-a8876d827df4,segment=NetworkSegment(e963d26c-0a32-4372-aefd-3f9403fc219c),segment_id=e963d26c-0a32-4372-aefd-3f9403fc219c)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:04.125287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-35c97452-4ede-4316-b399-49073dad69d7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e718bd05-4ddf-4ebd-b9d8-a8876d827df4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:06.080294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:435 started Oct 23 01:02:06.082972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=154000000,duration_sec=887,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:06.084033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:06.084366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:435 - starting polling. Elapsed:0.004 Oct 23 01:02:06.086785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:06.089812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:435 - port information retrieved. Elapsed:0.010 Oct 23 01:02:06.090144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:435 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:02:08.081259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:436 started Oct 23 01:02:08.085287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=155000000,duration_sec=889,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:08.086771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:08.087194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:436 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:02:08.487948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port e718bd05-4ddf-4ebd-b9d8-a8876d827df4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:08.488409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e718bd05-4ddf-4ebd-b9d8-a8876d827df4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:09.912752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:09Z,description='Default security group',id=d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e,is_default=True,name='default',project_id='1b27a71d07a64977930639755630b592',revision_number=1,rules=[SecurityGroupRule(496a1859-3e12-43f3-aada-ac84d8763b26),SecurityGroupRule(55a1876b-3710-4832-a3b5-ccb073b99a0b),SecurityGroupRule(7c02adb2-cd03-4e75-a624-9cd03a8fff8e),SecurityGroupRule(c6266a38-2497-4b48-ac0b-fd7bb39e2806)],shared=False,stateful=True,updated_at=2022-10-23T01:02:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:09.913380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:09.913762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:09Z,description=,direction='ingress',ethertype='IPv6',id=496a1859-3e12-43f3-aada-ac84d8763b26,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1b27a71d07a64977930639755630b592',protocol=,remote_address_group_id=,remote_group_id=d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e,remote_ip_prefix=,revision_number=0,security_group_id=d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e,updated_at=2022-10-23T01:02:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:09.914112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (496a1859-3e12-43f3-aada-ac84d8763b26), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:09.914555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:09.915231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:09Z,description=,direction='ingress',ethertype='IPv4',id=55a1876b-3710-4832-a3b5-ccb073b99a0b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1b27a71d07a64977930639755630b592',protocol=,remote_address_group_id=,remote_group_id=d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e,remote_ip_prefix=,revision_number=0,security_group_id=d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e,updated_at=2022-10-23T01:02:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:09.915577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (55a1876b-3710-4832-a3b5-ccb073b99a0b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:09.915900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:09.916637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:09Z,description=,direction='egress',ethertype='IPv6',id=7c02adb2-cd03-4e75-a624-9cd03a8fff8e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1b27a71d07a64977930639755630b592',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e,updated_at=2022-10-23T01:02:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:09.917077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7c02adb2-cd03-4e75-a624-9cd03a8fff8e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:09.917395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:09.918011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:09Z,description=,direction='egress',ethertype='IPv4',id=c6266a38-2497-4b48-ac0b-fd7bb39e2806,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1b27a71d07a64977930639755630b592',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e,updated_at=2022-10-23T01:02:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:09.918362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c6266a38-2497-4b48-ac0b-fd7bb39e2806), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:09.918870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1a701a92-4105-4312-930d-0bc3678d3768 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:10.057044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Resource SecurityGroup deleted: d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:10.057626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:10.058089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:10.073083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:10.073568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Resource SecurityGroupRule deleted: 496a1859-3e12-43f3-aada-ac84d8763b26 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:10.074034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (496a1859-3e12-43f3-aada-ac84d8763b26), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:10.074354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:10.074781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Resource SecurityGroupRule deleted: 55a1876b-3710-4832-a3b5-ccb073b99a0b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:10.075116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (55a1876b-3710-4832-a3b5-ccb073b99a0b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:10.075423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:10.075781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Resource SecurityGroupRule deleted: 7c02adb2-cd03-4e75-a624-9cd03a8fff8e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:10.076158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7c02adb2-cd03-4e75-a624-9cd03a8fff8e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:10.076463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:10.076851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Resource SecurityGroupRule deleted: c6266a38-2497-4b48-ac0b-fd7bb39e2806 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:10.077179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c6266a38-2497-4b48-ac0b-fd7bb39e2806), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:10.077508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-968a59d5-c44c-45bd-b029-b434e048c7a4 admin admin] Security group rule updated ['d1f376fb-265a-4b6f-b1ec-4ce6ebb89a4e'] Oct 23 01:02:10.081777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:437 started Oct 23 01:02:10.084751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=155000000,duration_sec=891,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:10.085329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:10.085668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:437 - starting polling. Elapsed:0.004 Oct 23 01:02:10.088068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:10.091489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:437 - port information retrieved. Elapsed:0.010 Oct 23 01:02:10.091819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:437 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:02:10.499199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port e718bd05-4ddf-4ebd-b9d8-a8876d827df4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:10.499575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e718bd05-4ddf-4ebd-b9d8-a8876d827df4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:12.082886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:438 started Oct 23 01:02:12.085389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=156000000,duration_sec=893,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:12.085995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:12.086524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:438 - starting polling. Elapsed:0.004 Oct 23 01:02:12.088988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:12.093118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:438 - port information retrieved. Elapsed:0.010 Oct 23 01:02:12.093567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:438 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:02:12.882647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:12Z,description='Default security group',id=4d00008b-987f-41f6-a6e3-88c2fbe324a6,is_default=True,name='default',project_id='6858985f64b7445da85b31928890ee14',revision_number=1,rules=[SecurityGroupRule(2a5891b4-6b84-4590-98a5-1b0fd2ed6f0a),SecurityGroupRule(4b696979-d827-43c0-a243-12f643f3b1dc),SecurityGroupRule(596fb9c2-099a-47bd-b8ca-20945a92d1cb),SecurityGroupRule(c9b769fb-7593-45d2-9395-492604934277)],shared=False,stateful=True,updated_at=2022-10-23T01:02:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:12.883097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (4d00008b-987f-41f6-a6e3-88c2fbe324a6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:12.883790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:12Z,description=,direction='egress',ethertype='IPv4',id=2a5891b4-6b84-4590-98a5-1b0fd2ed6f0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6858985f64b7445da85b31928890ee14',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4d00008b-987f-41f6-a6e3-88c2fbe324a6,updated_at=2022-10-23T01:02:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:12.884211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2a5891b4-6b84-4590-98a5-1b0fd2ed6f0a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:12.884546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:12.885242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:12Z,description=,direction='ingress',ethertype='IPv6',id=4b696979-d827-43c0-a243-12f643f3b1dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6858985f64b7445da85b31928890ee14',protocol=,remote_address_group_id=,remote_group_id=4d00008b-987f-41f6-a6e3-88c2fbe324a6,remote_ip_prefix=,revision_number=0,security_group_id=4d00008b-987f-41f6-a6e3-88c2fbe324a6,updated_at=2022-10-23T01:02:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:12.885589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4b696979-d827-43c0-a243-12f643f3b1dc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:12.886252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:12.886900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:12Z,description=,direction='ingress',ethertype='IPv4',id=596fb9c2-099a-47bd-b8ca-20945a92d1cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6858985f64b7445da85b31928890ee14',protocol=,remote_address_group_id=,remote_group_id=4d00008b-987f-41f6-a6e3-88c2fbe324a6,remote_ip_prefix=,revision_number=0,security_group_id=4d00008b-987f-41f6-a6e3-88c2fbe324a6,updated_at=2022-10-23T01:02:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:12.887242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (596fb9c2-099a-47bd-b8ca-20945a92d1cb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:12.887593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:12.888288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:12Z,description=,direction='egress',ethertype='IPv6',id=c9b769fb-7593-45d2-9395-492604934277,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6858985f64b7445da85b31928890ee14',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4d00008b-987f-41f6-a6e3-88c2fbe324a6,updated_at=2022-10-23T01:02:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:12.888625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c9b769fb-7593-45d2-9395-492604934277), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:12.888964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e1f2eaa4-21c2-41b0-937c-6550172360ab admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:13.027867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Resource SecurityGroup deleted: 4d00008b-987f-41f6-a6e3-88c2fbe324a6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.028407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (4d00008b-987f-41f6-a6e3-88c2fbe324a6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.028966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4d00008b-987f-41f6-a6e3-88c2fbe324a6',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:13.042408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4d00008b-987f-41f6-a6e3-88c2fbe324a6',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:13.042958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Resource SecurityGroupRule deleted: 2a5891b4-6b84-4590-98a5-1b0fd2ed6f0a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.043384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2a5891b4-6b84-4590-98a5-1b0fd2ed6f0a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.043871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:13.044420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Resource SecurityGroupRule deleted: 4b696979-d827-43c0-a243-12f643f3b1dc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.044880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4b696979-d827-43c0-a243-12f643f3b1dc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.045282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:13.045711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Resource SecurityGroupRule deleted: 596fb9c2-099a-47bd-b8ca-20945a92d1cb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.046152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (596fb9c2-099a-47bd-b8ca-20945a92d1cb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.046519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:13.046952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Resource SecurityGroupRule deleted: c9b769fb-7593-45d2-9395-492604934277 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.047289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c9b769fb-7593-45d2-9395-492604934277), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.047607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f9e8a37-bad7-42c6-8d8e-202da6b1e4be admin admin] Security group rule updated ['4d00008b-987f-41f6-a6e3-88c2fbe324a6'] Oct 23 01:02:13.446562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:13Z,description='Default security group',id=b430a7e3-11f8-4653-9468-43cd1b326217,is_default=True,name='default',project_id='e58a74eb5e4a4ec9b11a13da86ad886c',revision_number=1,rules=[SecurityGroupRule(0f5d328e-aaef-4a78-bcee-d0a2a61586d6),SecurityGroupRule(374d5e92-ae95-47f2-b8e4-0773418f4a59),SecurityGroupRule(3be7478d-90c8-41a0-8e26-764e3f3c8c63),SecurityGroupRule(8c2b37c2-360e-454a-a3f8-cfc838b938f5)],shared=False,stateful=True,updated_at=2022-10-23T01:02:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:13.447177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b430a7e3-11f8-4653-9468-43cd1b326217), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.447583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:13Z,description=,direction='egress',ethertype='IPv4',id=0f5d328e-aaef-4a78-bcee-d0a2a61586d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e58a74eb5e4a4ec9b11a13da86ad886c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b430a7e3-11f8-4653-9468-43cd1b326217,updated_at=2022-10-23T01:02:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:13.447915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0f5d328e-aaef-4a78-bcee-d0a2a61586d6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.448231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:13.448930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:13Z,description=,direction='ingress',ethertype='IPv6',id=374d5e92-ae95-47f2-b8e4-0773418f4a59,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e58a74eb5e4a4ec9b11a13da86ad886c',protocol=,remote_address_group_id=,remote_group_id=b430a7e3-11f8-4653-9468-43cd1b326217,remote_ip_prefix=,revision_number=0,security_group_id=b430a7e3-11f8-4653-9468-43cd1b326217,updated_at=2022-10-23T01:02:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:13.449282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (374d5e92-ae95-47f2-b8e4-0773418f4a59), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.449604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:13.450436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:13Z,description=,direction='egress',ethertype='IPv6',id=3be7478d-90c8-41a0-8e26-764e3f3c8c63,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e58a74eb5e4a4ec9b11a13da86ad886c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b430a7e3-11f8-4653-9468-43cd1b326217,updated_at=2022-10-23T01:02:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:13.450861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3be7478d-90c8-41a0-8e26-764e3f3c8c63), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.451183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:13.451868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:13Z,description=,direction='ingress',ethertype='IPv4',id=8c2b37c2-360e-454a-a3f8-cfc838b938f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e58a74eb5e4a4ec9b11a13da86ad886c',protocol=,remote_address_group_id=,remote_group_id=b430a7e3-11f8-4653-9468-43cd1b326217,remote_ip_prefix=,revision_number=0,security_group_id=b430a7e3-11f8-4653-9468-43cd1b326217,updated_at=2022-10-23T01:02:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:13.452209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8c2b37c2-360e-454a-a3f8-cfc838b938f5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.452532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c54930cf-7aca-43ab-a17c-3869462afcfa admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:13.583295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Resource SecurityGroup deleted: b430a7e3-11f8-4653-9468-43cd1b326217 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.583872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b430a7e3-11f8-4653-9468-43cd1b326217), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.584413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b430a7e3-11f8-4653-9468-43cd1b326217',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:13.598236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b430a7e3-11f8-4653-9468-43cd1b326217',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:13.598757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Resource SecurityGroupRule deleted: 0f5d328e-aaef-4a78-bcee-d0a2a61586d6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.599117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0f5d328e-aaef-4a78-bcee-d0a2a61586d6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.599496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:13.599885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Resource SecurityGroupRule deleted: 374d5e92-ae95-47f2-b8e4-0773418f4a59 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.600225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (374d5e92-ae95-47f2-b8e4-0773418f4a59), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.600602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:13.600998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Resource SecurityGroupRule deleted: 3be7478d-90c8-41a0-8e26-764e3f3c8c63 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.601346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3be7478d-90c8-41a0-8e26-764e3f3c8c63), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.601681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:13.602039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Resource SecurityGroupRule deleted: 8c2b37c2-360e-454a-a3f8-cfc838b938f5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:13.602396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8c2b37c2-360e-454a-a3f8-cfc838b938f5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:13.602747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-059f9101-8113-423f-aed1-6028fb081414 admin admin] Security group rule updated ['b430a7e3-11f8-4653-9468-43cd1b326217'] Oct 23 01:02:14.084404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:439 started Oct 23 01:02:14.087107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=158000000,duration_sec=895,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:14.087632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:14.088141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:439 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:16.086074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:440 started Oct 23 01:02:16.093226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=160000000,duration_sec=897,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:16.094741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:16.095273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:440 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:02:18.087134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:441 started Oct 23 01:02:18.090064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=161000000,duration_sec=899,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:18.090647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:18.090988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:441 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:19.198208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:19Z,description='Default security group',id=48da61ea-1163-450d-9a70-0729e6da4271,is_default=True,name='default',project_id='acb40df64ecd4373bff921e3b2dd3e2d',revision_number=1,rules=[SecurityGroupRule(4f7a70e7-b480-40c8-b940-a8053c8ddf8e),SecurityGroupRule(8721a46d-7b47-4fdd-940c-e8ac3357e69c),SecurityGroupRule(a4dbbaac-2bc9-4901-acfe-ac6d60bec5e0),SecurityGroupRule(de1a5a67-49a9-4b34-8acb-36f95367e28a)],shared=False,stateful=True,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:19.198862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (48da61ea-1163-450d-9a70-0729e6da4271), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.199508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='ingress',ethertype='IPv6',id=4f7a70e7-b480-40c8-b940-a8053c8ddf8e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='acb40df64ecd4373bff921e3b2dd3e2d',protocol=,remote_address_group_id=,remote_group_id=48da61ea-1163-450d-9a70-0729e6da4271,remote_ip_prefix=,revision_number=0,security_group_id=48da61ea-1163-450d-9a70-0729e6da4271,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:19.200407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4f7a70e7-b480-40c8-b940-a8053c8ddf8e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.200407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.201204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='ingress',ethertype='IPv4',id=8721a46d-7b47-4fdd-940c-e8ac3357e69c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='acb40df64ecd4373bff921e3b2dd3e2d',protocol=,remote_address_group_id=,remote_group_id=48da61ea-1163-450d-9a70-0729e6da4271,remote_ip_prefix=,revision_number=0,security_group_id=48da61ea-1163-450d-9a70-0729e6da4271,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:19.201637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (8721a46d-7b47-4fdd-940c-e8ac3357e69c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.202300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.203049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='egress',ethertype='IPv4',id=a4dbbaac-2bc9-4901-acfe-ac6d60bec5e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='acb40df64ecd4373bff921e3b2dd3e2d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48da61ea-1163-450d-9a70-0729e6da4271,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:19.203485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a4dbbaac-2bc9-4901-acfe-ac6d60bec5e0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.203899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.204635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='egress',ethertype='IPv6',id=de1a5a67-49a9-4b34-8acb-36f95367e28a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='acb40df64ecd4373bff921e3b2dd3e2d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48da61ea-1163-450d-9a70-0729e6da4271,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:19.205110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (de1a5a67-49a9-4b34-8acb-36f95367e28a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.205521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-5e3eff83-72cf-4dcc-bb72-14d69d64238d admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.351353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Resource SecurityGroup deleted: 48da61ea-1163-450d-9a70-0729e6da4271 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:19.352236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (48da61ea-1163-450d-9a70-0729e6da4271), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.352932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('48da61ea-1163-450d-9a70-0729e6da4271',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:19.373805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('48da61ea-1163-450d-9a70-0729e6da4271',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:19.374673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Resource SecurityGroupRule deleted: 4f7a70e7-b480-40c8-b940-a8053c8ddf8e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:19.375187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4f7a70e7-b480-40c8-b940-a8053c8ddf8e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.375716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.376398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Resource SecurityGroupRule deleted: 8721a46d-7b47-4fdd-940c-e8ac3357e69c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:19.377845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (8721a46d-7b47-4fdd-940c-e8ac3357e69c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.378334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.378977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Resource SecurityGroupRule deleted: a4dbbaac-2bc9-4901-acfe-ac6d60bec5e0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:19.379561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a4dbbaac-2bc9-4901-acfe-ac6d60bec5e0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.380071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.380710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Resource SecurityGroupRule deleted: de1a5a67-49a9-4b34-8acb-36f95367e28a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:19.381587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (de1a5a67-49a9-4b34-8acb-36f95367e28a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.382209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-55c642c5-1946-4bd1-8401-cca23db6ef07 admin admin] Security group rule updated ['48da61ea-1163-450d-9a70-0729e6da4271'] Oct 23 01:02:19.581231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b87d169e-bff8-42c4-9614-c05047887741 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:02:19Z,data_plane_status=None,description='',device_id='1614a879-9a6a-4689-93f5-5048d87ba671',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e58dd85b-78b4-42cc-babe-3cd25e0a2c9a,mac_address=fa:16:3e:c3:4a:b8,name='',network_id=858cf055-6f06-45a9-bd3f-2b834e6b7b79,numa_affinity_policy=,project_id='e3f6e9751be34c2fb4e0e1b9915e6b52',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e58dd85b-78b4-42cc-babe-3cd25e0a2c9a),security_group_ids=set([9e47da15-b648-4e05-8264-514053b0be27]),status='DOWN',updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:19.582023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b87d169e-bff8-42c4-9614-c05047887741 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e58dd85b-78b4-42cc-babe-3cd25e0a2c9a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:19.582696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b87d169e-bff8-42c4-9614-c05047887741 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group member updated {'9e47da15-b648-4e05-8264-514053b0be27'} Oct 23 01:02:20.034260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:19Z,description='Default security group',id=0520e471-e178-4a9b-8a0b-26009f5730fd,is_default=True,name='default',project_id='ea31c1875fdb4e52b0dde55cc65a6539',revision_number=1,rules=[SecurityGroupRule(0fec2531-2e35-4920-840f-833176a63104),SecurityGroupRule(81b11c73-7998-41d9-8e29-02b157eaf660),SecurityGroupRule(ac8cdfcf-d0fb-4180-b87f-fd8ad89b5993),SecurityGroupRule(b09514fd-4063-41ed-a4d4-a47ff6653f72)],shared=False,stateful=True,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:20.043502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (0520e471-e178-4a9b-8a0b-26009f5730fd), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.044377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='egress',ethertype='IPv6',id=0fec2531-2e35-4920-840f-833176a63104,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea31c1875fdb4e52b0dde55cc65a6539',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0520e471-e178-4a9b-8a0b-26009f5730fd,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:20.044943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0fec2531-2e35-4920-840f-833176a63104), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.045285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.046110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='ingress',ethertype='IPv4',id=81b11c73-7998-41d9-8e29-02b157eaf660,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea31c1875fdb4e52b0dde55cc65a6539',protocol=,remote_address_group_id=,remote_group_id=0520e471-e178-4a9b-8a0b-26009f5730fd,remote_ip_prefix=,revision_number=0,security_group_id=0520e471-e178-4a9b-8a0b-26009f5730fd,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:20.046460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (81b11c73-7998-41d9-8e29-02b157eaf660), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.046963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.047804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='ingress',ethertype='IPv6',id=ac8cdfcf-d0fb-4180-b87f-fd8ad89b5993,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea31c1875fdb4e52b0dde55cc65a6539',protocol=,remote_address_group_id=,remote_group_id=0520e471-e178-4a9b-8a0b-26009f5730fd,remote_ip_prefix=,revision_number=0,security_group_id=0520e471-e178-4a9b-8a0b-26009f5730fd,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:20.048153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ac8cdfcf-d0fb-4180-b87f-fd8ad89b5993), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.048462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.049284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:19Z,description=,direction='egress',ethertype='IPv4',id=b09514fd-4063-41ed-a4d4-a47ff6653f72,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea31c1875fdb4e52b0dde55cc65a6539',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0520e471-e178-4a9b-8a0b-26009f5730fd,updated_at=2022-10-23T01:02:19Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:20.049892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b09514fd-4063-41ed-a4d4-a47ff6653f72), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.050225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4edec288-be52-4d97-b2b9-5ecfaf2a811d admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.088282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:442 started Oct 23 01:02:20.091991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=163000000,duration_sec=901,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:20.093125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:20.093713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:442 - starting polling. Elapsed:0.006 Oct 23 01:02:20.096468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.099607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:442 - port information retrieved. Elapsed:0.012 Oct 23 01:02:20.100108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:442 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 01:02:20.183073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Resource SecurityGroup deleted: 0520e471-e178-4a9b-8a0b-26009f5730fd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:20.188691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (0520e471-e178-4a9b-8a0b-26009f5730fd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.189306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0520e471-e178-4a9b-8a0b-26009f5730fd',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:20.204444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0520e471-e178-4a9b-8a0b-26009f5730fd',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:20.205110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Resource SecurityGroupRule deleted: 0fec2531-2e35-4920-840f-833176a63104 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:20.205746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0fec2531-2e35-4920-840f-833176a63104), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.206082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.206475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Resource SecurityGroupRule deleted: 81b11c73-7998-41d9-8e29-02b157eaf660 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:20.208297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (81b11c73-7998-41d9-8e29-02b157eaf660), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.208623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.209028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Resource SecurityGroupRule deleted: ac8cdfcf-d0fb-4180-b87f-fd8ad89b5993 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:20.209376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ac8cdfcf-d0fb-4180-b87f-fd8ad89b5993), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.209692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.210062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Resource SecurityGroupRule deleted: b09514fd-4063-41ed-a4d4-a47ff6653f72 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:20.210425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b09514fd-4063-41ed-a4d4-a47ff6653f72), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.210737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2c76cde1-e19c-4203-9fb8-4f3ae6a8be15 admin admin] Security group rule updated ['0520e471-e178-4a9b-8a0b-26009f5730fd'] Oct 23 01:02:20.308565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c592e535-7b23-4f7e-89e2-aa9212ff2dd5 service neutron] Resource Port e58dd85b-78b4-42cc-babe-3cd25e0a2c9a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=e58dd85b-78b4-42cc-babe-3cd25e0a2c9a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e58dd85b-78b4-42cc-babe-3cd25e0a2c9a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:20.308975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c592e535-7b23-4f7e-89e2-aa9212ff2dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e58dd85b-78b4-42cc-babe-3cd25e0a2c9a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:20.613233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c592e535-7b23-4f7e-89e2-aa9212ff2dd5 service neutron] Resource Port e58dd85b-78b4-42cc-babe-3cd25e0a2c9a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e58dd85b-78b4-42cc-babe-3cd25e0a2c9a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e58dd85b-78b4-42cc-babe-3cd25e0a2c9a,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e58dd85b-78b4-42cc-babe-3cd25e0a2c9a,segment=NetworkSegment(d3b56b04-e2e1-4f00-a9db-1de40f8c425f),segment_id=d3b56b04-e2e1-4f00-a9db-1de40f8c425f)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:20.613642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c592e535-7b23-4f7e-89e2-aa9212ff2dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e58dd85b-78b4-42cc-babe-3cd25e0a2c9a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:22.089834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:443 started Oct 23 01:02:22.094170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=163000000,duration_sec=903,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:22.094702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:22.095061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:443 - starting polling. Elapsed:0.006 Oct 23 01:02:22.097439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:22.100462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:443 - port information retrieved. Elapsed:0.011 Oct 23 01:02:22.100821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:443 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:02:24.090527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:444 started Oct 23 01:02:24.092930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=164000000,duration_sec=905,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:24.093502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:24.093852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:444 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:26.091450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:445 started Oct 23 01:02:26.094015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=165000000,duration_sec=907,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:26.094610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:26.094977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:445 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:28.092579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:446 started Oct 23 01:02:28.096467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=166000000,duration_sec=909,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:28.097105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:28.097529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:446 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:02:30.093841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:447 started Oct 23 01:02:30.096398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=167000000,duration_sec=911,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:30.097027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:30.097380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:447 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:30.660949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port e58dd85b-78b4-42cc-babe-3cd25e0a2c9a updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:30.661331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e58dd85b-78b4-42cc-babe-3cd25e0a2c9a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:32.095096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:448 started Oct 23 01:02:32.097670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=168000000,duration_sec=913,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:32.098349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:32.098679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:448 - starting polling. Elapsed:0.004 Oct 23 01:02:32.101071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:32.104109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:448 - port information retrieved. Elapsed:0.009 Oct 23 01:02:32.104468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:448 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:02:32.791187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port e58dd85b-78b4-42cc-babe-3cd25e0a2c9a updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:32.791572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (e58dd85b-78b4-42cc-babe-3cd25e0a2c9a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:34.096181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:449 started Oct 23 01:02:34.099697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=170000000,duration_sec=915,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:34.100606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:34.101093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:449 - starting polling. Elapsed:0.005 Oct 23 01:02:34.104853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:34.109405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:449 - port information retrieved. Elapsed:0.013 Oct 23 01:02:34.109919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:449 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 01:02:36.096945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:450 started Oct 23 01:02:36.099514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=170000000,duration_sec=917,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:36.100155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:36.100569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:450 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:36.458850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edbbaedb-f075-48b8-9d6a-4196b71f5cfa tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:02:36Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=cb694e89-2b2a-42ab-ab86-e7168d28241c,mac_address=fa:16:3e:35:81:f2,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(cb694e89-2b2a-42ab-ab86-e7168d28241c),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:02:36Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:36.459403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edbbaedb-f075-48b8-9d6a-4196b71f5cfa tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cb694e89-2b2a-42ab-ab86-e7168d28241c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:37.142866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-edbbaedb-f075-48b8-9d6a-4196b71f5cfa tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port cb694e89-2b2a-42ab-ab86-e7168d28241c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'f0ee07d1-b8ca-459e-8280-f45d85d8a3a0'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:02:37.143516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-edbbaedb-f075-48b8-9d6a-4196b71f5cfa tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (cb694e89-2b2a-42ab-ab86-e7168d28241c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.097629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:451 started Oct 23 01:02:38.100090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=171000000,duration_sec=919,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:38.100675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:38.101039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:451 - starting polling. Elapsed:0.004 Oct 23 01:02:38.103360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.107235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:451 - port information retrieved. Elapsed:0.010 Oct 23 01:02:38.107636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:451 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:02:38.575011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:38Z,description='Default security group',id=057fa06d-62d5-4961-9f8e-8f4fbeee6b92,is_default=True,name='default',project_id='76d068cf8c3840a081352e7e45ee1fec',revision_number=1,rules=[SecurityGroupRule(3ad87c24-646a-4d87-8594-ab65aa1be0ca),SecurityGroupRule(49514b54-60d6-4f23-b078-11932983e8f8),SecurityGroupRule(998c9c1d-3b25-47fb-9942-5bb66d9b5234),SecurityGroupRule(f9b1e1bb-6d20-4029-a12a-343aed010d34)],shared=False,stateful=True,updated_at=2022-10-23T01:02:38Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:38.575641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (057fa06d-62d5-4961-9f8e-8f4fbeee6b92), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.576206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:38Z,description=,direction='ingress',ethertype='IPv4',id=3ad87c24-646a-4d87-8594-ab65aa1be0ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76d068cf8c3840a081352e7e45ee1fec',protocol=,remote_address_group_id=,remote_group_id=057fa06d-62d5-4961-9f8e-8f4fbeee6b92,remote_ip_prefix=,revision_number=0,security_group_id=057fa06d-62d5-4961-9f8e-8f4fbeee6b92,updated_at=2022-10-23T01:02:38Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:38.576572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3ad87c24-646a-4d87-8594-ab65aa1be0ca), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.577355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:38.578217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:38Z,description=,direction='egress',ethertype='IPv6',id=49514b54-60d6-4f23-b078-11932983e8f8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76d068cf8c3840a081352e7e45ee1fec',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=057fa06d-62d5-4961-9f8e-8f4fbeee6b92,updated_at=2022-10-23T01:02:38Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:38.578579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (49514b54-60d6-4f23-b078-11932983e8f8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.578837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:38.579699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:38Z,description=,direction='egress',ethertype='IPv4',id=998c9c1d-3b25-47fb-9942-5bb66d9b5234,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76d068cf8c3840a081352e7e45ee1fec',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=057fa06d-62d5-4961-9f8e-8f4fbeee6b92,updated_at=2022-10-23T01:02:38Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:38.580120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (998c9c1d-3b25-47fb-9942-5bb66d9b5234), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.580505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:38.581194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:38Z,description=,direction='ingress',ethertype='IPv6',id=f9b1e1bb-6d20-4029-a12a-343aed010d34,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76d068cf8c3840a081352e7e45ee1fec',protocol=,remote_address_group_id=,remote_group_id=057fa06d-62d5-4961-9f8e-8f4fbeee6b92,remote_ip_prefix=,revision_number=0,security_group_id=057fa06d-62d5-4961-9f8e-8f4fbeee6b92,updated_at=2022-10-23T01:02:38Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:38.581580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f9b1e1bb-6d20-4029-a12a-343aed010d34), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.581907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f27a8aa5-c37a-452d-8552-cd8542686767 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:38.934914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Resource SecurityGroup deleted: 057fa06d-62d5-4961-9f8e-8f4fbeee6b92 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:38.935287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (057fa06d-62d5-4961-9f8e-8f4fbeee6b92), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.935739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('057fa06d-62d5-4961-9f8e-8f4fbeee6b92',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:38.950551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('057fa06d-62d5-4961-9f8e-8f4fbeee6b92',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:38.951180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Resource SecurityGroupRule deleted: 3ad87c24-646a-4d87-8594-ab65aa1be0ca {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:38.951672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3ad87c24-646a-4d87-8594-ab65aa1be0ca), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.952047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:38.952658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Resource SecurityGroupRule deleted: 49514b54-60d6-4f23-b078-11932983e8f8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:38.953070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (49514b54-60d6-4f23-b078-11932983e8f8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.953446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:38.953977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Resource SecurityGroupRule deleted: 998c9c1d-3b25-47fb-9942-5bb66d9b5234 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:38.954565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (998c9c1d-3b25-47fb-9942-5bb66d9b5234), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.955135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:38.955628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Resource SecurityGroupRule deleted: f9b1e1bb-6d20-4029-a12a-343aed010d34 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:38.955971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f9b1e1bb-6d20-4029-a12a-343aed010d34), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:38.956277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fa794fba-3a6a-4d5a-9f87-bc43d386b576 admin admin] Security group rule updated ['057fa06d-62d5-4961-9f8e-8f4fbeee6b92'] Oct 23 01:02:40.098779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:452 started Oct 23 01:02:40.101713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=173000000,duration_sec=921,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:40.102479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:40.102837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:452 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:40.256306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:40Z,description='Default security group',id=f12b1bb3-3012-4351-b533-8172f7a79d3c,is_default=True,name='default',project_id='262a82c2ce86419bb11ded1bd8bab503',revision_number=1,rules=[SecurityGroupRule(0416574e-0f98-4571-83d5-ca8faa464173),SecurityGroupRule(5b293c1d-a8b8-4e11-a74c-a8dbe443b04b),SecurityGroupRule(6683760b-eb75-4948-a21e-fa6a13954cd2),SecurityGroupRule(ec955782-e372-479d-b041-2a2fb46ca44c)],shared=False,stateful=True,updated_at=2022-10-23T01:02:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:40.256763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (f12b1bb3-3012-4351-b533-8172f7a79d3c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.257469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:40Z,description=,direction='egress',ethertype='IPv4',id=0416574e-0f98-4571-83d5-ca8faa464173,normalized_cidr=None,port_range_max=,port_range_min=,project_id='262a82c2ce86419bb11ded1bd8bab503',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f12b1bb3-3012-4351-b533-8172f7a79d3c,updated_at=2022-10-23T01:02:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:40.257882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0416574e-0f98-4571-83d5-ca8faa464173), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.258412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:40.259150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:40Z,description=,direction='ingress',ethertype='IPv6',id=5b293c1d-a8b8-4e11-a74c-a8dbe443b04b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='262a82c2ce86419bb11ded1bd8bab503',protocol=,remote_address_group_id=,remote_group_id=f12b1bb3-3012-4351-b533-8172f7a79d3c,remote_ip_prefix=,revision_number=0,security_group_id=f12b1bb3-3012-4351-b533-8172f7a79d3c,updated_at=2022-10-23T01:02:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:40.259838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5b293c1d-a8b8-4e11-a74c-a8dbe443b04b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.260415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:40.261751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:40Z,description=,direction='ingress',ethertype='IPv4',id=6683760b-eb75-4948-a21e-fa6a13954cd2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='262a82c2ce86419bb11ded1bd8bab503',protocol=,remote_address_group_id=,remote_group_id=f12b1bb3-3012-4351-b533-8172f7a79d3c,remote_ip_prefix=,revision_number=0,security_group_id=f12b1bb3-3012-4351-b533-8172f7a79d3c,updated_at=2022-10-23T01:02:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:40.262371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6683760b-eb75-4948-a21e-fa6a13954cd2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.262890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:40.263812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:40Z,description=,direction='egress',ethertype='IPv6',id=ec955782-e372-479d-b041-2a2fb46ca44c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='262a82c2ce86419bb11ded1bd8bab503',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f12b1bb3-3012-4351-b533-8172f7a79d3c,updated_at=2022-10-23T01:02:40Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:40.264374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ec955782-e372-479d-b041-2a2fb46ca44c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.264912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-627e0b24-4350-4c94-9ba2-408a035af934 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:40.391791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Resource SecurityGroup deleted: f12b1bb3-3012-4351-b533-8172f7a79d3c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:40.392180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (f12b1bb3-3012-4351-b533-8172f7a79d3c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.392588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f12b1bb3-3012-4351-b533-8172f7a79d3c',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:40.403224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7ca19163-5d90-4a0c-87c8-ddf783a837f4 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource Port deleted: 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:40.403861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7ca19163-5d90-4a0c-87c8-ddf783a837f4 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.405923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7ca19163-5d90-4a0c-87c8-ddf783a837f4 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group member updated {'a78952a2-cccd-48f5-8f51-83df3683dcf4'} Oct 23 01:02:40.418525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f12b1bb3-3012-4351-b533-8172f7a79d3c',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:40.419102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Resource SecurityGroupRule deleted: 0416574e-0f98-4571-83d5-ca8faa464173 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:40.419539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0416574e-0f98-4571-83d5-ca8faa464173), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.419941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:40.420411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Resource SecurityGroupRule deleted: 5b293c1d-a8b8-4e11-a74c-a8dbe443b04b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:40.420905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5b293c1d-a8b8-4e11-a74c-a8dbe443b04b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.421342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:40.422057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Resource SecurityGroupRule deleted: 6683760b-eb75-4948-a21e-fa6a13954cd2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:40.422476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6683760b-eb75-4948-a21e-fa6a13954cd2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.423533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:40.424530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Resource SecurityGroupRule deleted: ec955782-e372-479d-b041-2a2fb46ca44c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:40.424982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ec955782-e372-479d-b041-2a2fb46ca44c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:40.425371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-69231ed6-36ae-456e-bfbb-273066d2d0b3 admin admin] Security group rule updated ['f12b1bb3-3012-4351-b533-8172f7a79d3c'] Oct 23 01:02:42.101662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:453 started Oct 23 01:02:42.105217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=176000000,duration_sec=923,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:42.107125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:42.107535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:453 - starting polling. Elapsed:0.007 Oct 23 01:02:42.109968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:42.111847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 not present in bridge br-int Oct 23 01:02:42.112254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:02:42.112611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554'] Oct 23 01:02:42.113151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0a74b0dc-ddb2-4d8b-a5c0-f0a50bcc2554 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:02:42.117494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:453 - port information retrieved. Elapsed:0.016 Oct 23 01:02:42.117836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:453 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 23 01:02:42.119123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroup deleted: a78952a2-cccd-48f5-8f51-83df3683dcf4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:42.119660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (a78952a2-cccd-48f5-8f51-83df3683dcf4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:42.120184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a78952a2-cccd-48f5-8f51-83df3683dcf4',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:42.135135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a78952a2-cccd-48f5-8f51-83df3683dcf4',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:42.136203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: 30ab51a9-2df6-42d8-8785-3feb901b8c77 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:42.136756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (30ab51a9-2df6-42d8-8785-3feb901b8c77), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:42.137706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:02:42.138078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: e7c41469-495c-4d03-925b-dbe3afc92f13 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:42.138576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e7c41469-495c-4d03-925b-dbe3afc92f13), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:42.139111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:02:42.139492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: 2e5faaee-3cce-4c42-a582-0e626f4342d3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:42.139798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2e5faaee-3cce-4c42-a582-0e626f4342d3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:42.140298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:02:42.140671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource SecurityGroupRule deleted: 76e5cc8c-bb60-4e03-8008-ad43e0fba1b7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:42.141076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (76e5cc8c-bb60-4e03-8008-ad43e0fba1b7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:42.141749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c2563e3a-aeda-403c-937b-4209c265a3e6 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Security group rule updated ['a78952a2-cccd-48f5-8f51-83df3683dcf4'] Oct 23 01:02:42.501048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f938fd99-8fc3-455b-90b6-fb25d9d3fe49 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Resource Port deleted: 451ffa52-bde4-4d4d-bb86-4181fb85999c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:42.501727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f938fd99-8fc3-455b-90b6-fb25d9d3fe49 tempest-AttachVolumeShelveTestJSON-1171119098 tempest-AttachVolumeShelveTestJSON-1171119098-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (451ffa52-bde4-4d4d-bb86-4181fb85999c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:44.102116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:454 started Oct 23 01:02:44.104984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=176000000,duration_sec=925,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:44.105577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:44.105902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:454 - starting polling. Elapsed:0.004 Oct 23 01:02:44.108191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:44.109832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 451ffa52-bde4-4d4d-bb86-4181fb85999c not present in bridge br-int Oct 23 01:02:44.110194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:02:44.110463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['451ffa52-bde4-4d4d-bb86-4181fb85999c'] Oct 23 01:02:44.111243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 451ffa52-bde4-4d4d-bb86-4181fb85999c is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:02:44.114062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:454 - port information retrieved. Elapsed:0.012 Oct 23 01:02:44.114390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:454 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 01:02:46.083463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8bbf2d02-3d3a-4f30-9cef-f646c372bb53 admin admin] Resource Port deleted: 045e8cb5-b097-4c96-a318-d42be89b2e6f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:46.085543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8bbf2d02-3d3a-4f30-9cef-f646c372bb53 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (045e8cb5-b097-4c96-a318-d42be89b2e6f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:46.103269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:455 started Oct 23 01:02:46.106052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2c9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=177000000,duration_sec=927,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:46.106838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:46.107348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:455 - starting polling. Elapsed:0.004 Oct 23 01:02:46.109680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:46.114326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-045e8cb5-b0, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:02:46.121012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2c9e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:46.121640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['045e8cb5-b097-4c96-a318-d42be89b2e6f'] Oct 23 01:02:46.122124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:02:46.195326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5b964-953f-4caf-95a2-4cdcdec429fb]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:02:46.199572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:455 - port information retrieved. Elapsed:0.096 Oct 23 01:02:46.199885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:455 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.097 Oct 23 01:02:47.197218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["065222bb-b9ac-4ac2-9250-9fb83da270da","delete","qr-045e8cb5-b0",17,["map",[["attached-mac","fa:16:3e:8e:5e:9a"],["iface-id","045e8cb5-b097-4c96-a318-d42be89b2e6f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:02:47.255585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1f7715bf-1d7b-4ae5-b117-28ccada390e7 admin admin] Resource Port deleted: c3d281d7-77bc-45d4-bfbc-c30a363df5dd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:47.255970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1f7715bf-1d7b-4ae5-b117-28ccada390e7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (c3d281d7-77bc-45d4-bfbc-c30a363df5dd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:47.618935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6b80b97f-02d2-4c10-8dd6-b048bf93253a","delete","qg-c3d281d7-77",14,["map",[["attached-mac","fa:16:3e:3b:d1:28"],["iface-id","c3d281d7-77bc-45d4-bfbc-c30a363df5dd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:02:47.967186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-028f1996-e775-413b-b483-2b31b95e8c54 admin admin] Resource Subnet deleted: 52944cd4-669b-4a10-a076-1661bc94a4a7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:47.967807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-028f1996-e775-413b-b483-2b31b95e8c54 admin admin] Publish callbacks [] for Subnet (52944cd4-669b-4a10-a076-1661bc94a4a7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.104954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:456 started Oct 23 01:02:48.118185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f48e7b47-b79a-4bfe-ac5a-8010d02b6f2d","delete","tap02ea638b-e7",10,["map",[["attached-mac","fa:16:3e:c6:9d:7d"],["iface-id","02ea638b-e76a-43d4-a7af-3b5be374e752"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:02:48.119229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ca0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=178000000,duration_sec=929,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:48.119865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:48.120320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:456 - starting polling. Elapsed:0.016 Oct 23 01:02:48.122349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.140491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ca2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:48.146725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ca4,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:48.155612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ca6,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:48.155855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:456 - port information retrieved. Elapsed:0.051 Oct 23 01:02:48.156177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', '7e98a342-e446-43cd-a9ad-e1e77aed3807', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '36027a75-3b26-4728-a464-23e4dbba5d4a', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'added': set(), 'removed': {'02ea638b-e76a-43d4-a7af-3b5be374e752', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '045e8cb5-b097-4c96-a318-d42be89b2e6f'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:02:48.156503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:456 - agent port security group processed in 0.000 Oct 23 01:02:48.159204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:02:48.159505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'02ea638b-e76a-43d4-a7af-3b5be374e752', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '045e8cb5-b097-4c96-a318-d42be89b2e6f'} Oct 23 01:02:48.160039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 045e8cb5-b097-4c96-a318-d42be89b2e6f is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:02:48.160451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:02:48.226024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[789b0cca-0a7f-4dd7-a6a5-0f18f1f7d262]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:02:48.226935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'02ea638b-e76a-43d4-a7af-3b5be374e752', 'c3d281d7-77bc-45d4-bfbc-c30a363df5dd', '045e8cb5-b097-4c96-a318-d42be89b2e6f'} removed Oct 23 01:02:48.304553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c84794b6-cb64-4244-8460-291989cd69f5 admin admin] Resource Port deleted: 02ea638b-e76a-43d4-a7af-3b5be374e752 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.305075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c84794b6-cb64-4244-8460-291989cd69f5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (02ea638b-e76a-43d4-a7af-3b5be374e752), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.379708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:02:48.380266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 5 from net-id = f8105e98-346f-4369-be4d-2cb2d399c07a, seg-id = 356 Oct 23 01:02:48.384485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x13211949,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:48.387481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2ca8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4452}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:48.388018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:02:48.388520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:456 - treat_devices_removed completed in 0.229 Oct 23 01:02:48.389150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:456 - ports processed. Elapsed:0.284 Oct 23 01:02:48.389544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:456 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.285 Oct 23 01:02:48.466831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef30ceda-bf97-4e1d-ba4d-eeff522ebef7 None None] Resource Port deleted: 02ea638b-e76a-43d4-a7af-3b5be374e752 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.467475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef30ceda-bf97-4e1d-ba4d-eeff522ebef7 None None] Skipped duplicate delete event for 02ea638b-e76a-43d4-a7af-3b5be374e752 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:02:48.559155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c84794b6-cb64-4244-8460-291989cd69f5 admin admin] Resource Network deleted: f8105e98-346f-4369-be4d-2cb2d399c07a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.559518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c84794b6-cb64-4244-8460-291989cd69f5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (f8105e98-346f-4369-be4d-2cb2d399c07a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.871017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Resource SecurityGroup deleted: 14f9cc16-79bc-467c-acc1-06912dbdf96d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.871392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (14f9cc16-79bc-467c-acc1-06912dbdf96d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.871861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('14f9cc16-79bc-467c-acc1-06912dbdf96d',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:48.886489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('14f9cc16-79bc-467c-acc1-06912dbdf96d',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:48.887087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Resource SecurityGroupRule deleted: 46f9c9d6-9c2a-4afe-9e56-598279b4a018 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.887590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (46f9c9d6-9c2a-4afe-9e56-598279b4a018), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.887926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 01:02:48.889132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Resource SecurityGroupRule deleted: 52aace79-53fa-4e3d-aa4b-eb8cbd2b3034 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.889691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (52aace79-53fa-4e3d-aa4b-eb8cbd2b3034), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.890882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 01:02:48.891266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Resource SecurityGroupRule deleted: 65f7331b-050b-40ac-9eb2-6f8b75dc3c95 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.891612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (65f7331b-050b-40ac-9eb2-6f8b75dc3c95), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.891931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 01:02:48.892333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Resource SecurityGroupRule deleted: fb3b4529-77bb-4ee5-bb8e-3ae581ddc7d5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:48.893245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fb3b4529-77bb-4ee5-bb8e-3ae581ddc7d5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:48.893567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4ae1c5e5-bbb5-4c81-a1a4-98bd6e3bdfed admin admin] Security group rule updated ['14f9cc16-79bc-467c-acc1-06912dbdf96d'] Oct 23 01:02:49.214859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:49Z,description='Default security group',id=ae0586b5-786e-4367-a9ba-861b0d14799e,is_default=True,name='default',project_id='a76aea41c1c7467d9305756da0605a3c',revision_number=1,rules=[SecurityGroupRule(15440249-52bb-40fe-8797-443aa5e17548),SecurityGroupRule(494fb488-78dd-442b-bb82-2f28578162c4),SecurityGroupRule(a212bcbf-ee3b-4ee5-bb4c-4e1a4406baec),SecurityGroupRule(a31781a0-45b7-4647-95e2-cabb8cce92b2)],shared=False,stateful=True,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.215239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (ae0586b5-786e-4367-a9ba-861b0d14799e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.215853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='ingress',ethertype='IPv4',id=15440249-52bb-40fe-8797-443aa5e17548,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a76aea41c1c7467d9305756da0605a3c',protocol=,remote_address_group_id=,remote_group_id=ae0586b5-786e-4367-a9ba-861b0d14799e,remote_ip_prefix=,revision_number=0,security_group_id=ae0586b5-786e-4367-a9ba-861b0d14799e,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.216470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (15440249-52bb-40fe-8797-443aa5e17548), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.216837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.217507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='egress',ethertype='IPv4',id=494fb488-78dd-442b-bb82-2f28578162c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a76aea41c1c7467d9305756da0605a3c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ae0586b5-786e-4367-a9ba-861b0d14799e,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.217882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (494fb488-78dd-442b-bb82-2f28578162c4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.218381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.219493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='ingress',ethertype='IPv6',id=a212bcbf-ee3b-4ee5-bb4c-4e1a4406baec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a76aea41c1c7467d9305756da0605a3c',protocol=,remote_address_group_id=,remote_group_id=ae0586b5-786e-4367-a9ba-861b0d14799e,remote_ip_prefix=,revision_number=0,security_group_id=ae0586b5-786e-4367-a9ba-861b0d14799e,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.219881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a212bcbf-ee3b-4ee5-bb4c-4e1a4406baec), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.220206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.220903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='egress',ethertype='IPv6',id=a31781a0-45b7-4647-95e2-cabb8cce92b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a76aea41c1c7467d9305756da0605a3c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ae0586b5-786e-4367-a9ba-861b0d14799e,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.221254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a31781a0-45b7-4647-95e2-cabb8cce92b2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.221572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6f8bd4c4-de14-4cc8-8646-1c47ffbcd704 admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.351558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Resource SecurityGroup deleted: ae0586b5-786e-4367-a9ba-861b0d14799e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.352650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (ae0586b5-786e-4367-a9ba-861b0d14799e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.353161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ae0586b5-786e-4367-a9ba-861b0d14799e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:49.374877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ae0586b5-786e-4367-a9ba-861b0d14799e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:49.375734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Resource SecurityGroupRule deleted: 15440249-52bb-40fe-8797-443aa5e17548 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.376099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (15440249-52bb-40fe-8797-443aa5e17548), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.377362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.377903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Resource SecurityGroupRule deleted: 494fb488-78dd-442b-bb82-2f28578162c4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.378605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (494fb488-78dd-442b-bb82-2f28578162c4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.379178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.379734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Resource SecurityGroupRule deleted: a212bcbf-ee3b-4ee5-bb4c-4e1a4406baec {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.380088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a212bcbf-ee3b-4ee5-bb4c-4e1a4406baec), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.380570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.380974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Resource SecurityGroupRule deleted: a31781a0-45b7-4647-95e2-cabb8cce92b2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.381319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a31781a0-45b7-4647-95e2-cabb8cce92b2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.381660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3f7f989d-7065-41cb-a9c8-a281233e629c admin admin] Security group rule updated ['ae0586b5-786e-4367-a9ba-861b0d14799e'] Oct 23 01:02:49.793668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:49Z,description='Default security group',id=857adeba-6cfe-4a88-ba39-f9a93c1fe5f1,is_default=True,name='default',project_id='8eb4a3e3e7644703bbfc2eb3e9c512d2',revision_number=1,rules=[SecurityGroupRule(3d7c1817-d051-41b9-9e7b-127464ef0b79),SecurityGroupRule(49bd2134-88c3-4a4f-ab0d-4e85fe98343e),SecurityGroupRule(79090574-af8e-444c-bb21-19018b7e1458),SecurityGroupRule(e9038abe-381c-4b85-8c0b-4087ed2c7223)],shared=False,stateful=True,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.794054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (857adeba-6cfe-4a88-ba39-f9a93c1fe5f1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.794676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='ingress',ethertype='IPv6',id=3d7c1817-d051-41b9-9e7b-127464ef0b79,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8eb4a3e3e7644703bbfc2eb3e9c512d2',protocol=,remote_address_group_id=,remote_group_id=857adeba-6cfe-4a88-ba39-f9a93c1fe5f1,remote_ip_prefix=,revision_number=0,security_group_id=857adeba-6cfe-4a88-ba39-f9a93c1fe5f1,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.795270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3d7c1817-d051-41b9-9e7b-127464ef0b79), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.795603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:49.796463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='egress',ethertype='IPv4',id=49bd2134-88c3-4a4f-ab0d-4e85fe98343e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8eb4a3e3e7644703bbfc2eb3e9c512d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=857adeba-6cfe-4a88-ba39-f9a93c1fe5f1,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.796842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (49bd2134-88c3-4a4f-ab0d-4e85fe98343e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.797332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:49.797997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='ingress',ethertype='IPv4',id=79090574-af8e-444c-bb21-19018b7e1458,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8eb4a3e3e7644703bbfc2eb3e9c512d2',protocol=,remote_address_group_id=,remote_group_id=857adeba-6cfe-4a88-ba39-f9a93c1fe5f1,remote_ip_prefix=,revision_number=0,security_group_id=857adeba-6cfe-4a88-ba39-f9a93c1fe5f1,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.798349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (79090574-af8e-444c-bb21-19018b7e1458), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.798674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:49.799324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:49Z,description=,direction='egress',ethertype='IPv6',id=e9038abe-381c-4b85-8c0b-4087ed2c7223,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8eb4a3e3e7644703bbfc2eb3e9c512d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=857adeba-6cfe-4a88-ba39-f9a93c1fe5f1,updated_at=2022-10-23T01:02:49Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:49.799997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e9038abe-381c-4b85-8c0b-4087ed2c7223), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.800324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-40510b4b-be6a-46a1-9efb-21a10d6f185f admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:49.928302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Resource SecurityGroup deleted: 857adeba-6cfe-4a88-ba39-f9a93c1fe5f1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.928681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (857adeba-6cfe-4a88-ba39-f9a93c1fe5f1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.929355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('857adeba-6cfe-4a88-ba39-f9a93c1fe5f1',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:49.942731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('857adeba-6cfe-4a88-ba39-f9a93c1fe5f1',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:49.943391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Resource SecurityGroupRule deleted: 3d7c1817-d051-41b9-9e7b-127464ef0b79 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.943915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3d7c1817-d051-41b9-9e7b-127464ef0b79), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.944481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:49.944902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Resource SecurityGroupRule deleted: 49bd2134-88c3-4a4f-ab0d-4e85fe98343e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.945448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (49bd2134-88c3-4a4f-ab0d-4e85fe98343e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.945880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:49.946300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Resource SecurityGroupRule deleted: 79090574-af8e-444c-bb21-19018b7e1458 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.946702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (79090574-af8e-444c-bb21-19018b7e1458), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.947017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:49.947854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Resource SecurityGroupRule deleted: e9038abe-381c-4b85-8c0b-4087ed2c7223 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:49.948339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e9038abe-381c-4b85-8c0b-4087ed2c7223), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:49.949245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a1b4c805-5091-4595-bc8c-dcb6d8760282 admin admin] Security group rule updated ['857adeba-6cfe-4a88-ba39-f9a93c1fe5f1'] Oct 23 01:02:50.105221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:457 started Oct 23 01:02:50.108314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2caa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=179000000,duration_sec=931,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:50.109742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:50.110465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:457 - starting polling. Elapsed:0.005 Oct 23 01:02:50.112802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.114382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 02ea638b-e76a-43d4-a7af-3b5be374e752 not present in bridge br-int Oct 23 01:02:50.114883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:02:50.115210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['02ea638b-e76a-43d4-a7af-3b5be374e752'] Oct 23 01:02:50.115580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 02ea638b-e76a-43d4-a7af-3b5be374e752 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:02:50.118222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:457 - port information retrieved. Elapsed:0.013 Oct 23 01:02:50.118551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:457 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 01:02:50.368354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:02:50Z,description='Default security group',id=3d874561-d9ea-427b-9bc1-0560041928f9,is_default=True,name='default',project_id='f68d94ce4db54bfba8f8535de053defe',revision_number=1,rules=[SecurityGroupRule(22f80144-7480-443e-8fa4-dc7e2d33da3b),SecurityGroupRule(5e4487d5-2d89-4024-b035-7519a61774f5),SecurityGroupRule(84675881-ecd6-408a-9347-5cc6a04151ae),SecurityGroupRule(c8fb0dae-9369-4a83-ad3e-f3c54e354d27)],shared=False,stateful=True,updated_at=2022-10-23T01:02:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:50.369033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (3d874561-d9ea-427b-9bc1-0560041928f9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.369369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:50Z,description=,direction='egress',ethertype='IPv6',id=22f80144-7480-443e-8fa4-dc7e2d33da3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68d94ce4db54bfba8f8535de053defe',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3d874561-d9ea-427b-9bc1-0560041928f9,updated_at=2022-10-23T01:02:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:50.369726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (22f80144-7480-443e-8fa4-dc7e2d33da3b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.370063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:50.370761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:50Z,description=,direction='ingress',ethertype='IPv6',id=5e4487d5-2d89-4024-b035-7519a61774f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68d94ce4db54bfba8f8535de053defe',protocol=,remote_address_group_id=,remote_group_id=3d874561-d9ea-427b-9bc1-0560041928f9,remote_ip_prefix=,revision_number=0,security_group_id=3d874561-d9ea-427b-9bc1-0560041928f9,updated_at=2022-10-23T01:02:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:50.371107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5e4487d5-2d89-4024-b035-7519a61774f5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.372127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:50.372808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:50Z,description=,direction='ingress',ethertype='IPv4',id=84675881-ecd6-408a-9347-5cc6a04151ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68d94ce4db54bfba8f8535de053defe',protocol=,remote_address_group_id=,remote_group_id=3d874561-d9ea-427b-9bc1-0560041928f9,remote_ip_prefix=,revision_number=0,security_group_id=3d874561-d9ea-427b-9bc1-0560041928f9,updated_at=2022-10-23T01:02:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:50.373419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (84675881-ecd6-408a-9347-5cc6a04151ae), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.373811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:50.374540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:02:50Z,description=,direction='egress',ethertype='IPv4',id=c8fb0dae-9369-4a83-ad3e-f3c54e354d27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f68d94ce4db54bfba8f8535de053defe',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3d874561-d9ea-427b-9bc1-0560041928f9,updated_at=2022-10-23T01:02:50Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:02:50.375121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c8fb0dae-9369-4a83-ad3e-f3c54e354d27), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.375510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-768fbd2f-b2bb-48a0-bb05-64a760358ebe admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:50.505926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Resource SecurityGroup deleted: 3d874561-d9ea-427b-9bc1-0560041928f9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:50.506350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (3d874561-d9ea-427b-9bc1-0560041928f9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.506982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3d874561-d9ea-427b-9bc1-0560041928f9',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:02:50.521782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3d874561-d9ea-427b-9bc1-0560041928f9',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:02:50.522576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Resource SecurityGroupRule deleted: 22f80144-7480-443e-8fa4-dc7e2d33da3b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:50.522985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (22f80144-7480-443e-8fa4-dc7e2d33da3b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.523359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:50.523792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Resource SecurityGroupRule deleted: 5e4487d5-2d89-4024-b035-7519a61774f5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:50.524169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5e4487d5-2d89-4024-b035-7519a61774f5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.524491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:50.524981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Resource SecurityGroupRule deleted: 84675881-ecd6-408a-9347-5cc6a04151ae {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:50.525388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (84675881-ecd6-408a-9347-5cc6a04151ae), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.525708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:50.526148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Resource SecurityGroupRule deleted: c8fb0dae-9369-4a83-ad3e-f3c54e354d27 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:02:50.526491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c8fb0dae-9369-4a83-ad3e-f3c54e354d27), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:02:50.526805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-92fbd4fe-0d93-4cc2-8caa-61341116fc42 admin admin] Security group rule updated ['3d874561-d9ea-427b-9bc1-0560041928f9'] Oct 23 01:02:52.106590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:458 started Oct 23 01:02:52.109036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=180000000,duration_sec=933,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:52.109641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:52.110017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:458 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:54.107271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:459 started Oct 23 01:02:54.110304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=181000000,duration_sec=935,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:54.110978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:54.111394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:459 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:56.107890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:460 started Oct 23 01:02:56.110478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=181000000,duration_sec=937,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:56.111081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:56.111435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:460 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:02:58.108947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:461 started Oct 23 01:02:58.111449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=182000000,duration_sec=939,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:02:58.112414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:02:58.112414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:461 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:00.110221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:462 started Oct 23 01:03:00.113266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=184000000,duration_sec=941,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:00.113875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:00.114222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:462 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:02.111092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:463 started Oct 23 01:03:02.113632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=184000000,duration_sec=943,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:02.114206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:02.114549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:463 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:03.911036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-499b8a38-fdb5-4d22-95f2-bd225d4d3626 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: e718bd05-4ddf-4ebd-b9d8-a8876d827df4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:03.911636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-499b8a38-fdb5-4d22-95f2-bd225d4d3626 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (e718bd05-4ddf-4ebd-b9d8-a8876d827df4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:03.911810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-499b8a38-fdb5-4d22-95f2-bd225d4d3626 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'27fe5e11-7bd5-432e-9b1b-087e3e2991c9'} Oct 23 01:03:04.111784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:464 started Oct 23 01:03:04.115946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=186000000,duration_sec=945,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:04.116989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:04.117596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:464 - starting polling. Elapsed:0.006 Oct 23 01:03:04.121100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:04.122568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port e718bd05-4ddf-4ebd-b9d8-a8876d827df4 not present in bridge br-int Oct 23 01:03:04.122950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:03:04.123413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['e718bd05-4ddf-4ebd-b9d8-a8876d827df4'] Oct 23 01:03:04.124094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port e718bd05-4ddf-4ebd-b9d8-a8876d827df4 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:03:04.127407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:464 - port information retrieved. Elapsed:0.016 Oct 23 01:03:04.127749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:464 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 23 01:03:06.113097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:465 started Oct 23 01:03:06.115551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=186000000,duration_sec=947,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:06.116152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:06.116497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:465 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:06.205549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroup deleted: 27fe5e11-7bd5-432e-9b1b-087e3e2991c9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:06.205936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (27fe5e11-7bd5-432e-9b1b-087e3e2991c9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:06.206380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('27fe5e11-7bd5-432e-9b1b-087e3e2991c9',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:06.362848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('27fe5e11-7bd5-432e-9b1b-087e3e2991c9',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:06.363611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 3b73bb2c-52b9-4bc1-a8f2-6243d1585a0a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:06.364169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3b73bb2c-52b9-4bc1-a8f2-6243d1585a0a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:06.364699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:03:06.365157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: eb2a0f1b-a504-4a91-a8be-7234a02e7f30 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:06.365503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (eb2a0f1b-a504-4a91-a8be-7234a02e7f30), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:06.365826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:03:06.366180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 60c9787b-1fcb-45e7-bd57-9e4dbb3ea36b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:06.366684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (60c9787b-1fcb-45e7-bd57-9e4dbb3ea36b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:06.367001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:03:06.367558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 1e4592bf-1cba-4878-951e-5284e397eaf0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:06.368058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1e4592bf-1cba-4878-951e-5284e397eaf0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:06.368376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-90b5f3ff-55eb-4e95-b4fd-a40117c1d520 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['27fe5e11-7bd5-432e-9b1b-087e3e2991c9'] Oct 23 01:03:06.584975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6ea4d8e2-0200-4fd0-be16-67ef120ece01 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: 637b8626-323a-4d8d-a79d-6d498a70cc01 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:06.585348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6ea4d8e2-0200-4fd0-be16-67ef120ece01 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (637b8626-323a-4d8d-a79d-6d498a70cc01), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:08.114128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:466 started Oct 23 01:03:08.116922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=188000000,duration_sec=949,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:08.117557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:08.117877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:466 - starting polling. Elapsed:0.004 Oct 23 01:03:08.120157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:08.122151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 637b8626-323a-4d8d-a79d-6d498a70cc01 not present in bridge br-int Oct 23 01:03:08.122323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:03:08.122739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['637b8626-323a-4d8d-a79d-6d498a70cc01'] Oct 23 01:03:08.123322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 637b8626-323a-4d8d-a79d-6d498a70cc01 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:03:08.126321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:466 - port information retrieved. Elapsed:0.012 Oct 23 01:03:08.126685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:466 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 01:03:09.399994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:09Z,description='Default security group',id=b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d,is_default=True,name='default',project_id='1d85fd32447b4aa3ad27a91199ce3dc0',revision_number=1,rules=[SecurityGroupRule(125a21c8-faa5-4708-a17a-5a7154ca150b),SecurityGroupRule(2ccd3856-1801-48e4-97a2-79bb58fd3279),SecurityGroupRule(322b5335-19b8-435b-9e39-4b47472c90ce),SecurityGroupRule(5e7bde26-d7aa-4299-90cd-5f70298d0f75)],shared=False,stateful=True,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:09.400535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.401215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='egress',ethertype='IPv4',id=125a21c8-faa5-4708-a17a-5a7154ca150b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d85fd32447b4aa3ad27a91199ce3dc0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:09.401764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (125a21c8-faa5-4708-a17a-5a7154ca150b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.402073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:09.402839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='egress',ethertype='IPv6',id=2ccd3856-1801-48e4-97a2-79bb58fd3279,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d85fd32447b4aa3ad27a91199ce3dc0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:09.403303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2ccd3856-1801-48e4-97a2-79bb58fd3279), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.404812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:09.406114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='ingress',ethertype='IPv6',id=322b5335-19b8-435b-9e39-4b47472c90ce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d85fd32447b4aa3ad27a91199ce3dc0',protocol=,remote_address_group_id=,remote_group_id=b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d,remote_ip_prefix=,revision_number=0,security_group_id=b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:09.406474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (322b5335-19b8-435b-9e39-4b47472c90ce), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.406806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:09.407484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='ingress',ethertype='IPv4',id=5e7bde26-d7aa-4299-90cd-5f70298d0f75,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1d85fd32447b4aa3ad27a91199ce3dc0',protocol=,remote_address_group_id=,remote_group_id=b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d,remote_ip_prefix=,revision_number=0,security_group_id=b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:09.408044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5e7bde26-d7aa-4299-90cd-5f70298d0f75), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.408369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d182f07c-e8b9-4fc6-a7cc-8e71fb1fb8bf admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:09.626917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Resource SecurityGroup deleted: b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:09.627298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.627831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:09.641080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:09.641541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Resource SecurityGroupRule deleted: 125a21c8-faa5-4708-a17a-5a7154ca150b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:09.641941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (125a21c8-faa5-4708-a17a-5a7154ca150b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.642275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:09.642662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Resource SecurityGroupRule deleted: 2ccd3856-1801-48e4-97a2-79bb58fd3279 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:09.643003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2ccd3856-1801-48e4-97a2-79bb58fd3279), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.643325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:09.643694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Resource SecurityGroupRule deleted: 322b5335-19b8-435b-9e39-4b47472c90ce {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:09.644030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (322b5335-19b8-435b-9e39-4b47472c90ce), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.644344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:09.644757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Resource SecurityGroupRule deleted: 5e7bde26-d7aa-4299-90cd-5f70298d0f75 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:09.645095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5e7bde26-d7aa-4299-90cd-5f70298d0f75), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:09.645408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2014b9e8-a9a1-44c5-a8dc-77bd1a99ce4e admin admin] Security group rule updated ['b8f72525-d0d8-4c8c-b1d2-cbcaecf7182d'] Oct 23 01:03:10.114996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:467 started Oct 23 01:03:10.117756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=189000000,duration_sec=951,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:10.118334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:10.118684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:467 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:10.171575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:09Z,description='Default security group',id=834281a9-92d3-4c14-aa76-57b638aeced3,is_default=True,name='default',project_id='a72be0a0fc694e9b8f90aec17d7e6333',revision_number=1,rules=[SecurityGroupRule(24d47066-34ed-48c0-a992-7fb35ebfb3a7),SecurityGroupRule(3a2325ef-8b3b-4451-a8e8-afa25923856b),SecurityGroupRule(636db85b-029d-4da8-8a4e-d48a1c18f76c),SecurityGroupRule(ec65a129-9010-4308-b348-7c6cb5029f0f)],shared=False,stateful=True,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:10.172184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (834281a9-92d3-4c14-aa76-57b638aeced3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.172999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='egress',ethertype='IPv4',id=24d47066-34ed-48c0-a992-7fb35ebfb3a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a72be0a0fc694e9b8f90aec17d7e6333',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=834281a9-92d3-4c14-aa76-57b638aeced3,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:10.173536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (24d47066-34ed-48c0-a992-7fb35ebfb3a7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.173870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.174536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='egress',ethertype='IPv6',id=3a2325ef-8b3b-4451-a8e8-afa25923856b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a72be0a0fc694e9b8f90aec17d7e6333',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=834281a9-92d3-4c14-aa76-57b638aeced3,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:10.174914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3a2325ef-8b3b-4451-a8e8-afa25923856b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.175242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.176056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='ingress',ethertype='IPv6',id=636db85b-029d-4da8-8a4e-d48a1c18f76c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a72be0a0fc694e9b8f90aec17d7e6333',protocol=,remote_address_group_id=,remote_group_id=834281a9-92d3-4c14-aa76-57b638aeced3,remote_ip_prefix=,revision_number=0,security_group_id=834281a9-92d3-4c14-aa76-57b638aeced3,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:10.176610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (636db85b-029d-4da8-8a4e-d48a1c18f76c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.176962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.177610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:09Z,description=,direction='ingress',ethertype='IPv4',id=ec65a129-9010-4308-b348-7c6cb5029f0f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a72be0a0fc694e9b8f90aec17d7e6333',protocol=,remote_address_group_id=,remote_group_id=834281a9-92d3-4c14-aa76-57b638aeced3,remote_ip_prefix=,revision_number=0,security_group_id=834281a9-92d3-4c14-aa76-57b638aeced3,updated_at=2022-10-23T01:03:09Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:10.177959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ec65a129-9010-4308-b348-7c6cb5029f0f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.178285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-52746af2-d10d-44dd-b26d-3561f7cb1f3b admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.319963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Resource SecurityGroup deleted: 834281a9-92d3-4c14-aa76-57b638aeced3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:10.320442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (834281a9-92d3-4c14-aa76-57b638aeced3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.320989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('834281a9-92d3-4c14-aa76-57b638aeced3',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:10.337219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('834281a9-92d3-4c14-aa76-57b638aeced3',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:10.337775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Resource SecurityGroupRule deleted: 24d47066-34ed-48c0-a992-7fb35ebfb3a7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:10.338210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (24d47066-34ed-48c0-a992-7fb35ebfb3a7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.338707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.339200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Resource SecurityGroupRule deleted: 3a2325ef-8b3b-4451-a8e8-afa25923856b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:10.339987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3a2325ef-8b3b-4451-a8e8-afa25923856b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.340713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.341154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Resource SecurityGroupRule deleted: 636db85b-029d-4da8-8a4e-d48a1c18f76c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:10.341584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (636db85b-029d-4da8-8a4e-d48a1c18f76c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.341965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.342392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Resource SecurityGroupRule deleted: ec65a129-9010-4308-b348-7c6cb5029f0f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:10.342793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ec65a129-9010-4308-b348-7c6cb5029f0f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.343185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-750a3de3-f3f7-4de1-a536-f13c80a2c88f admin admin] Security group rule updated ['834281a9-92d3-4c14-aa76-57b638aeced3'] Oct 23 01:03:10.974652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e5195d25-c7d0-4dd6-b4ee-3a0a56e23caa tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: 2eafe9f3-8116-4c7f-a6ed-69810adb3007 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:10.975665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e5195d25-c7d0-4dd6-b4ee-3a0a56e23caa tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (2eafe9f3-8116-4c7f-a6ed-69810adb3007), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:10.976459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e5195d25-c7d0-4dd6-b4ee-3a0a56e23caa tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'60dd1184-0af4-4724-85fc-d8387f89088a'} Oct 23 01:03:11.465294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:11Z,description='Default security group',id=215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9,is_default=True,name='default',project_id='d869b2413ff442e98257ed9a26c971ae',revision_number=1,rules=[SecurityGroupRule(2ce5b9a4-f460-4d8c-ad71-c133ef3faede),SecurityGroupRule(7c2e7b25-bef6-4dd2-bc08-abb7f68320d2),SecurityGroupRule(e9e63214-7273-45dc-afe0-9182a7f5b5dc),SecurityGroupRule(fb3126b9-e7e1-4e18-ac0f-ef8c0dcb458f)],shared=False,stateful=True,updated_at=2022-10-23T01:03:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:11.465938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:11.467011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:11Z,description=,direction='ingress',ethertype='IPv6',id=2ce5b9a4-f460-4d8c-ad71-c133ef3faede,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d869b2413ff442e98257ed9a26c971ae',protocol=,remote_address_group_id=,remote_group_id=215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9,remote_ip_prefix=,revision_number=0,security_group_id=215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9,updated_at=2022-10-23T01:03:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:11.467663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2ce5b9a4-f460-4d8c-ad71-c133ef3faede), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:11.468157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:11.469027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:11Z,description=,direction='egress',ethertype='IPv6',id=7c2e7b25-bef6-4dd2-bc08-abb7f68320d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d869b2413ff442e98257ed9a26c971ae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9,updated_at=2022-10-23T01:03:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:11.469551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7c2e7b25-bef6-4dd2-bc08-abb7f68320d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:11.470033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:11.470824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:11Z,description=,direction='ingress',ethertype='IPv4',id=e9e63214-7273-45dc-afe0-9182a7f5b5dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d869b2413ff442e98257ed9a26c971ae',protocol=,remote_address_group_id=,remote_group_id=215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9,remote_ip_prefix=,revision_number=0,security_group_id=215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9,updated_at=2022-10-23T01:03:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:11.471573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e9e63214-7273-45dc-afe0-9182a7f5b5dc), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:11.472560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:11.475585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:11Z,description=,direction='egress',ethertype='IPv4',id=fb3126b9-e7e1-4e18-ac0f-ef8c0dcb458f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d869b2413ff442e98257ed9a26c971ae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9,updated_at=2022-10-23T01:03:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:11.475952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fb3126b9-e7e1-4e18-ac0f-ef8c0dcb458f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:11.476331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:11.673448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T01:03:11Z,description='',dns_domain=None,id=2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156,mtu=1500,name='tempest-VolumesActionsTest-1742443066-network',project_id='d869b2413ff442e98257ed9a26c971ae',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156),segments=[NetworkSegment(e7ab9837-9c43-4d30-8a73-a18c8566438e)],shared=False,status='ACTIVE',updated_at=2022-10-23T01:03:11Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:11.673803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-9e648222-4373-45ac-b0b5-a9056c4ea078 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156 with segmentation id not found. Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 01:03:11.820048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 01:03:11.821188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 01:03:11.821188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 01:03:11.821188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 01:03:11.821188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156 with segmentation id not found. Oct 23 01:03:11.821188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 01:03:11.966544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-def7a9a1-8406-4af3-833a-3b4c432dc868 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(42f5e163-66ce-489d-ada5-91072aa62173)],cidr=172.20.0.0/28,created_at=2022-10-23T01:03:11Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=bb1a3bca-dedb-41f2-b42e-3e8e945ab451,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1742443066-subnet',network_id=2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156,project_id='d869b2413ff442e98257ed9a26c971ae',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T01:03:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:11.966903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-def7a9a1-8406-4af3-833a-3b4c432dc868 admin admin] Publish callbacks [] for Subnet (bb1a3bca-dedb-41f2-b42e-3e8e945ab451), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:12.117926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:468 started Oct 23 01:03:12.121723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=193000000,duration_sec=953,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:12.122433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:12.123610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:468 - starting polling. Elapsed:0.005 Oct 23 01:03:12.125828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:12.127354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2eafe9f3-8116-4c7f-a6ed-69810adb3007 not present in bridge br-int Oct 23 01:03:12.127782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:03:12.128157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['2eafe9f3-8116-4c7f-a6ed-69810adb3007'] Oct 23 01:03:12.128575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2eafe9f3-8116-4c7f-a6ed-69810adb3007 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:03:12.131377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:468 - port information retrieved. Elapsed:0.014 Oct 23 01:03:12.131827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:468 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 01:03:12.837967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:12Z,description='Default security group',id=d8c94791-e525-4d71-a319-6baf6af887ea,is_default=True,name='default',project_id='b986667b29b343909928f0daff579920',revision_number=1,rules=[SecurityGroupRule(b004ca6b-6e36-4dc3-95e1-60c86a368e1c),SecurityGroupRule(b627c003-5b35-47f6-89f0-4909c30e532e),SecurityGroupRule(f5916b3b-4cef-402a-bb0c-438de8a2ef47),SecurityGroupRule(fbe9fb4a-aac2-4551-b74b-c91e487ff142)],shared=False,stateful=True,updated_at=2022-10-23T01:03:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:12.838371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (d8c94791-e525-4d71-a319-6baf6af887ea), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:12.839011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:12Z,description=,direction='ingress',ethertype='IPv6',id=b004ca6b-6e36-4dc3-95e1-60c86a368e1c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b986667b29b343909928f0daff579920',protocol=,remote_address_group_id=,remote_group_id=d8c94791-e525-4d71-a319-6baf6af887ea,remote_ip_prefix=,revision_number=0,security_group_id=d8c94791-e525-4d71-a319-6baf6af887ea,updated_at=2022-10-23T01:03:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:12.839361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b004ca6b-6e36-4dc3-95e1-60c86a368e1c), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:12.839700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:12.840354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:12Z,description=,direction='egress',ethertype='IPv6',id=b627c003-5b35-47f6-89f0-4909c30e532e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b986667b29b343909928f0daff579920',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d8c94791-e525-4d71-a319-6baf6af887ea,updated_at=2022-10-23T01:03:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:12.841261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b627c003-5b35-47f6-89f0-4909c30e532e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:12.841623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:12.842480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:12Z,description=,direction='ingress',ethertype='IPv4',id=f5916b3b-4cef-402a-bb0c-438de8a2ef47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b986667b29b343909928f0daff579920',protocol=,remote_address_group_id=,remote_group_id=d8c94791-e525-4d71-a319-6baf6af887ea,remote_ip_prefix=,revision_number=0,security_group_id=d8c94791-e525-4d71-a319-6baf6af887ea,updated_at=2022-10-23T01:03:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:12.842833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f5916b3b-4cef-402a-bb0c-438de8a2ef47), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:12.843137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:12.843825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:12Z,description=,direction='egress',ethertype='IPv4',id=fbe9fb4a-aac2-4551-b74b-c91e487ff142,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b986667b29b343909928f0daff579920',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d8c94791-e525-4d71-a319-6baf6af887ea,updated_at=2022-10-23T01:03:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:12.844163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fbe9fb4a-aac2-4551-b74b-c91e487ff142), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:12.844487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:12.999837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T01:03:12Z,description='',dns_domain=None,id=ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6,mtu=1500,name='tempest-VolumesActionsTest-133333169-network',project_id='b986667b29b343909928f0daff579920',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6),segments=[NetworkSegment(7cd63f8f-16ec-43ab-9b5e-43fde5619c31)],shared=False,status='ACTIVE',updated_at=2022-10-23T01:03:12Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:13.000219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-23f7f529-83fc-48d6-862e-b6520eefde97 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6 with segmentation id not found. Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 01:03:13.073097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 01:03:13.074206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 01:03:13.074206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 01:03:13.074206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 01:03:13.074206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6 with segmentation id not found. Oct 23 01:03:13.074206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 01:03:13.347992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3bd34b97-08e6-4e73-9812-c623c501131e admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(78c9c930-4928-459c-a701-e7bc43485928)],cidr=172.20.0.0/28,created_at=2022-10-23T01:03:13Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=253c7ab6-18a2-4116-982a-02a7dc34c191,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-133333169-subnet',network_id=ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6,project_id='b986667b29b343909928f0daff579920',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T01:03:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:13.349505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3bd34b97-08e6-4e73-9812-c623c501131e admin admin] Publish callbacks [] for Subnet (253c7ab6-18a2-4116-982a-02a7dc34c191), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:13.424882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroup deleted: 60dd1184-0af4-4724-85fc-d8387f89088a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:13.425469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (60dd1184-0af4-4724-85fc-d8387f89088a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:13.426180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('60dd1184-0af4-4724-85fc-d8387f89088a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:13.488835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('60dd1184-0af4-4724-85fc-d8387f89088a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:13.489617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: d609b42e-6fe1-4278-a112-c3e5edf23fc2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:13.490188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d609b42e-6fe1-4278-a112-c3e5edf23fc2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:13.491926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:03:13.493892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: f3394cad-42d7-4c5f-9f22-cf0a515d2062 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:13.495408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f3394cad-42d7-4c5f-9f22-cf0a515d2062), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:13.495961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:03:13.497047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 0d7c024c-17cc-4722-95ae-ff1584b14385 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:13.497727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0d7c024c-17cc-4722-95ae-ff1584b14385), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:13.498249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:03:13.499345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 5b5fa101-2c7a-48db-985c-69ede5d0c04c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:13.499793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5b5fa101-2c7a-48db-985c-69ede5d0c04c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:13.500696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9b673a1f-49ee-4fe3-b31b-fe9acb6b385f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['60dd1184-0af4-4724-85fc-d8387f89088a'] Oct 23 01:03:13.864167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c9b95886-a7e4-454a-a7e7-4600425bcad4 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: 8bed982c-09ac-4308-8015-c166586e609c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:13.865718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c9b95886-a7e4-454a-a7e7-4600425bcad4 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (8bed982c-09ac-4308-8015-c166586e609c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:14.119393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:469 started Oct 23 01:03:14.122804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=193000000,duration_sec=955,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:14.123633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:14.124035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:469 - starting polling. Elapsed:0.005 Oct 23 01:03:14.126197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:14.127739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 8bed982c-09ac-4308-8015-c166586e609c not present in bridge br-int Oct 23 01:03:14.128139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:03:14.128516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['8bed982c-09ac-4308-8015-c166586e609c'] Oct 23 01:03:14.128868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 8bed982c-09ac-4308-8015-c166586e609c is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:03:14.131622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:469 - port information retrieved. Elapsed:0.012 Oct 23 01:03:14.131915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:469 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 01:03:14.174071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:14Z,description='tempest-description--2005826046',id=10988333-e444-48fc-819a-71f5dfcdf37d,is_default=False,name='tempest-securitygroup--144245880',project_id='3fae115d5ad049b5b40c59212216d458',revision_number=1,rules=[SecurityGroupRule(e4fe3607-b6f3-45a8-93c0-c89e5d0f816d),SecurityGroupRule(e5f661da-b8d8-4178-a94f-680c4cd56098)],shared=False,stateful=True,updated_at=2022-10-23T01:03:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:14.174521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (10988333-e444-48fc-819a-71f5dfcdf37d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:14.175145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:14Z,description=,direction='egress',ethertype='IPv6',id=e4fe3607-b6f3-45a8-93c0-c89e5d0f816d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10988333-e444-48fc-819a-71f5dfcdf37d,updated_at=2022-10-23T01:03:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:14.175504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e4fe3607-b6f3-45a8-93c0-c89e5d0f816d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:14.175840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:03:14.182056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:14Z,description=,direction='egress',ethertype='IPv4',id=e5f661da-b8d8-4178-a94f-680c4cd56098,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10988333-e444-48fc-819a-71f5dfcdf37d,updated_at=2022-10-23T01:03:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:14.182535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e5f661da-b8d8-4178-a94f-680c4cd56098), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:14.182868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-45950905-f4a6-4051-8b99-e9066f7a57af tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:03:14.313920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b9307632-d9de-4a59-9737-39445838c7fc tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:14Z,description='',direction='ingress',ethertype='IPv4',id=fdb43a8f-8a26-4002-807e-f3575633edd9,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='3fae115d5ad049b5b40c59212216d458',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10988333-e444-48fc-819a-71f5dfcdf37d,updated_at=2022-10-23T01:03:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:14.314684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b9307632-d9de-4a59-9737-39445838c7fc tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fdb43a8f-8a26-4002-807e-f3575633edd9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:14.315228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b9307632-d9de-4a59-9737-39445838c7fc tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:03:14.452694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b4dff7d0-9bb6-49b6-abff-e7590f68ca75 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:14Z,description='',direction='ingress',ethertype='IPv4',id=4a6223f2-7943-46ef-9620-5ff68d6a03af,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10988333-e444-48fc-819a-71f5dfcdf37d,updated_at=2022-10-23T01:03:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:14.453859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b4dff7d0-9bb6-49b6-abff-e7590f68ca75 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4a6223f2-7943-46ef-9620-5ff68d6a03af), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:14.454200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b4dff7d0-9bb6-49b6-abff-e7590f68ca75 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:03:14.909945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0377c285-11e4-4f92-bd7c-dd39e603f1d0 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:03:14Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6f04c088-4b2e-434b-b8ee-92c77bf7300e,mac_address=fa:16:3e:49:f1:fe,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6f04c088-4b2e-434b-b8ee-92c77bf7300e),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:03:14Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:14.910326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0377c285-11e4-4f92-bd7c-dd39e603f1d0 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (6f04c088-4b2e-434b-b8ee-92c77bf7300e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:15.281959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0377c285-11e4-4f92-bd7c-dd39e603f1d0 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port 6f04c088-4b2e-434b-b8ee-92c77bf7300e updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '8d1649df-49c4-4db1-968a-d3a0554bf421'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:15.282450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0377c285-11e4-4f92-bd7c-dd39e603f1d0 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (6f04c088-4b2e-434b-b8ee-92c77bf7300e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:16.120312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:470 started Oct 23 01:03:16.124660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=194000000,duration_sec=957,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:16.125285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:16.125629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:470 - starting polling. Elapsed:0.005 Oct 23 01:03:16.128528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:16.131271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:470 - port information retrieved. Elapsed:0.011 Oct 23 01:03:16.131636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:470 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 01:03:17.971046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-21a713b5-e463-4ea0-9b00-8e0472375629 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:03:17Z,data_plane_status=None,description='',device_id='f909ab3b-6de1-43e6-a214-a65fb12fdd8b',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0b92dbda-db20-4405-91e4-52e1123c9209,mac_address=fa:16:3e:39:63:81,name='',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,numa_affinity_policy=,project_id='3fae115d5ad049b5b40c59212216d458',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0b92dbda-db20-4405-91e4-52e1123c9209),security_group_ids=set([10988333-e444-48fc-819a-71f5dfcdf37d]),status='DOWN',updated_at=2022-10-23T01:03:17Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:17.971697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-21a713b5-e463-4ea0-9b00-8e0472375629 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0b92dbda-db20-4405-91e4-52e1123c9209), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:17.972067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-21a713b5-e463-4ea0-9b00-8e0472375629 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'10988333-e444-48fc-819a-71f5dfcdf37d'} Oct 23 01:03:18.121186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:471 started Oct 23 01:03:18.125657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=196000000,duration_sec=959,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:18.126252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:18.126593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:471 - starting polling. Elapsed:0.006 Oct 23 01:03:18.128681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:18.131302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:471 - port information retrieved. Elapsed:0.010 Oct 23 01:03:18.131632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:471 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:03:18.532747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0aff9747-02c2-4ba8-b61e-4272c0ecb31b service neutron] Resource Port 0b92dbda-db20-4405-91e4-52e1123c9209 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0b92dbda-db20-4405-91e4-52e1123c9209,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b92dbda-db20-4405-91e4-52e1123c9209,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:18.533356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0aff9747-02c2-4ba8-b61e-4272c0ecb31b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0b92dbda-db20-4405-91e4-52e1123c9209), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:18.828886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0aff9747-02c2-4ba8-b61e-4272c0ecb31b service neutron] Resource Port 0b92dbda-db20-4405-91e4-52e1123c9209 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b92dbda-db20-4405-91e4-52e1123c9209,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b92dbda-db20-4405-91e4-52e1123c9209,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0b92dbda-db20-4405-91e4-52e1123c9209,segment=NetworkSegment(e963d26c-0a32-4372-aefd-3f9403fc219c),segment_id=e963d26c-0a32-4372-aefd-3f9403fc219c)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:18.830670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0aff9747-02c2-4ba8-b61e-4272c0ecb31b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0b92dbda-db20-4405-91e4-52e1123c9209), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:20.121860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:472 started Oct 23 01:03:20.124601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=195000000,duration_sec=961,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:20.125297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:20.125655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:472 - starting polling. Elapsed:0.004 Oct 23 01:03:20.127875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:20.130648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:472 - port information retrieved. Elapsed:0.009 Oct 23 01:03:20.131005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:472 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:03:22.123309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:473 started Oct 23 01:03:22.125888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=197000000,duration_sec=963,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:22.126459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:22.126807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:473 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:22.894490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0b92dbda-db20-4405-91e4-52e1123c9209 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:22.894950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0b92dbda-db20-4405-91e4-52e1123c9209), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:24.124552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:474 started Oct 23 01:03:24.127150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ccc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=198000000,duration_sec=965,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:24.127731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:24.128062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:474 - starting polling. Elapsed:0.004 Oct 23 01:03:24.130204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:24.132811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:474 - port information retrieved. Elapsed:0.009 Oct 23 01:03:24.133265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:474 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:03:24.892011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 0b92dbda-db20-4405-91e4-52e1123c9209 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:24.893234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (0b92dbda-db20-4405-91e4-52e1123c9209), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:26.132752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:475 started Oct 23 01:03:26.132752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=199000000,duration_sec=967,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:26.132752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:26.132752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:475 - starting polling. Elapsed:0.004 Oct 23 01:03:26.133599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:26.133599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:475 - port information retrieved. Elapsed:0.008 Oct 23 01:03:26.133773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:475 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:03:27.773967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ab19b15e-fb4e-4972-a3ad-dc29fd330e7b admin admin] Resource Subnet deleted: bb1a3bca-dedb-41f2-b42e-3e8e945ab451 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:27.774623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ab19b15e-fb4e-4972-a3ad-dc29fd330e7b admin admin] Publish callbacks [] for Subnet (bb1a3bca-dedb-41f2-b42e-3e8e945ab451), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:28.126411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:476 started Oct 23 01:03:28.129761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=200000000,duration_sec=969,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:28.130498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:28.130937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:476 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:03:28.320893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-27b6f793-c4d5-4f31-8e9d-64a05bb26068 admin admin] Resource Network deleted: 2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:28.324055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-27b6f793-c4d5-4f31-8e9d-64a05bb26068 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (2a8bad4c-26a1-44b8-a6d4-d5a3f0a3b156), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:28.555110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b53b7e8b-c5e7-4ce0-80da-70165d340db3 admin admin] Resource Subnet deleted: 253c7ab6-18a2-4116-982a-02a7dc34c191 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:28.555568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b53b7e8b-c5e7-4ce0-80da-70165d340db3 admin admin] Publish callbacks [] for Subnet (253c7ab6-18a2-4116-982a-02a7dc34c191), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.022361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:28Z,description='Default security group',id=f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d,is_default=True,name='default',project_id='60637b5ab3e84e3b9bd7a52d6ab06c11',revision_number=1,rules=[SecurityGroupRule(695d25f0-2c5a-427c-a7c9-71a5d4127ae4),SecurityGroupRule(7fabdf6d-0167-4300-abc5-cd63aa7296a1),SecurityGroupRule(9ec2d1a2-4955-4a2c-a6a9-5e3d204c2149),SecurityGroupRule(df8d5bac-ed93-4b17-9055-f453d090da9a)],shared=False,stateful=True,updated_at=2022-10-23T01:03:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:29.023046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.023478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:28Z,description=,direction='ingress',ethertype='IPv4',id=695d25f0-2c5a-427c-a7c9-71a5d4127ae4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='60637b5ab3e84e3b9bd7a52d6ab06c11',protocol=,remote_address_group_id=,remote_group_id=f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d,remote_ip_prefix=,revision_number=0,security_group_id=f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d,updated_at=2022-10-23T01:03:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:29.023916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (695d25f0-2c5a-427c-a7c9-71a5d4127ae4), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.024336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.025062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:28Z,description=,direction='egress',ethertype='IPv6',id=7fabdf6d-0167-4300-abc5-cd63aa7296a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='60637b5ab3e84e3b9bd7a52d6ab06c11',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d,updated_at=2022-10-23T01:03:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:29.025665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7fabdf6d-0167-4300-abc5-cd63aa7296a1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.026195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.027304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:28Z,description=,direction='ingress',ethertype='IPv6',id=9ec2d1a2-4955-4a2c-a6a9-5e3d204c2149,normalized_cidr=None,port_range_max=,port_range_min=,project_id='60637b5ab3e84e3b9bd7a52d6ab06c11',protocol=,remote_address_group_id=,remote_group_id=f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d,remote_ip_prefix=,revision_number=0,security_group_id=f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d,updated_at=2022-10-23T01:03:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:29.027915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9ec2d1a2-4955-4a2c-a6a9-5e3d204c2149), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.028444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.029317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:28Z,description=,direction='egress',ethertype='IPv4',id=df8d5bac-ed93-4b17-9055-f453d090da9a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='60637b5ab3e84e3b9bd7a52d6ab06c11',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d,updated_at=2022-10-23T01:03:28Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:29.029883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (df8d5bac-ed93-4b17-9055-f453d090da9a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.030945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-6864154b-04eb-4feb-8268-24bbb895c9a3 admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.089207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-158f6339-d931-4ae4-b6db-75fd1785f082 admin admin] Resource Network deleted: ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.091262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-158f6339-d931-4ae4-b6db-75fd1785f082 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (ae24d21c-b67c-4f4a-bd98-754c0e3d7ad6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.189473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Resource SecurityGroup deleted: f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.189846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.190296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:29.206311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:29.207292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Resource SecurityGroupRule deleted: 695d25f0-2c5a-427c-a7c9-71a5d4127ae4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.207980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (695d25f0-2c5a-427c-a7c9-71a5d4127ae4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.208642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.209380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Resource SecurityGroupRule deleted: 7fabdf6d-0167-4300-abc5-cd63aa7296a1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.209720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7fabdf6d-0167-4300-abc5-cd63aa7296a1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.210280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.210936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Resource SecurityGroupRule deleted: 9ec2d1a2-4955-4a2c-a6a9-5e3d204c2149 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.211454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9ec2d1a2-4955-4a2c-a6a9-5e3d204c2149), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.212053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.212653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Resource SecurityGroupRule deleted: df8d5bac-ed93-4b17-9055-f453d090da9a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.213457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (df8d5bac-ed93-4b17-9055-f453d090da9a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.213774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ab84487b-099f-4249-af3c-b727b0db64fd admin admin] Security group rule updated ['f3eb8fd2-e62f-4ce7-a6c2-e367b36de27d'] Oct 23 01:03:29.734259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Resource SecurityGroup deleted: 215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.734975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.736058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:29.751113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:29.751673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Resource SecurityGroupRule deleted: 2ce5b9a4-f460-4d8c-ad71-c133ef3faede {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.752039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2ce5b9a4-f460-4d8c-ad71-c133ef3faede), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.752527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:29.753087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Resource SecurityGroupRule deleted: 7c2e7b25-bef6-4dd2-bc08-abb7f68320d2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.753690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7c2e7b25-bef6-4dd2-bc08-abb7f68320d2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.754165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:29.754527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Resource SecurityGroupRule deleted: e9e63214-7273-45dc-afe0-9182a7f5b5dc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.755194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e9e63214-7273-45dc-afe0-9182a7f5b5dc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.755691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:29.756518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Resource SecurityGroupRule deleted: fb3126b9-e7e1-4e18-ac0f-ef8c0dcb458f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:29.756893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fb3126b9-e7e1-4e18-ac0f-ef8c0dcb458f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:29.757205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-60da8d08-2ad4-4952-8f04-486739bed2b0 admin admin] Security group rule updated ['215593cc-1a6c-4c4e-8e4f-4f0f271dc2f9'] Oct 23 01:03:30.127270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:477 started Oct 23 01:03:30.130502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=201000000,duration_sec=971,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:30.131670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:30.132173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:477 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:03:30.235381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Resource SecurityGroup deleted: d8c94791-e525-4d71-a319-6baf6af887ea {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:30.236266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (d8c94791-e525-4d71-a319-6baf6af887ea), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.237241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d8c94791-e525-4d71-a319-6baf6af887ea',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:30.259282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d8c94791-e525-4d71-a319-6baf6af887ea',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:30.261146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Resource SecurityGroupRule deleted: b004ca6b-6e36-4dc3-95e1-60c86a368e1c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:30.261851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b004ca6b-6e36-4dc3-95e1-60c86a368e1c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.262375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:30.263161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Resource SecurityGroupRule deleted: b627c003-5b35-47f6-89f0-4909c30e532e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:30.265749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b627c003-5b35-47f6-89f0-4909c30e532e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.266446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:30.267228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Resource SecurityGroupRule deleted: f5916b3b-4cef-402a-bb0c-438de8a2ef47 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:30.267771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f5916b3b-4cef-402a-bb0c-438de8a2ef47), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.268163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:30.268605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Resource SecurityGroupRule deleted: fbe9fb4a-aac2-4551-b74b-c91e487ff142 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:30.269322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fbe9fb4a-aac2-4551-b74b-c91e487ff142), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.269864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-74f15f7d-21e7-4041-b00c-802cc570ebeb admin admin] Security group rule updated ['d8c94791-e525-4d71-a319-6baf6af887ea'] Oct 23 01:03:30.384179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:30Z,description='Default security group',id=49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a,is_default=True,name='default',project_id='7e97fa3e253f435d817619feeeb5260c',revision_number=1,rules=[SecurityGroupRule(0d860759-6279-4f80-bada-3b6f3c1368e1),SecurityGroupRule(47578cb4-3e6a-4d4d-8254-c68c557766b2),SecurityGroupRule(4afd4d82-7b94-4101-a545-772bf26e7089),SecurityGroupRule(66b9b2fe-7dca-490a-8c21-21bfaaec6276)],shared=False,stateful=True,updated_at=2022-10-23T01:03:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:30.384561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.385252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:30Z,description=,direction='egress',ethertype='IPv6',id=0d860759-6279-4f80-bada-3b6f3c1368e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e97fa3e253f435d817619feeeb5260c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a,updated_at=2022-10-23T01:03:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:30.385607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0d860759-6279-4f80-bada-3b6f3c1368e1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.386307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:03:30.386969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:30Z,description=,direction='ingress',ethertype='IPv4',id=47578cb4-3e6a-4d4d-8254-c68c557766b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e97fa3e253f435d817619feeeb5260c',protocol=,remote_address_group_id=,remote_group_id=49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a,remote_ip_prefix=,revision_number=0,security_group_id=49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a,updated_at=2022-10-23T01:03:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:30.387312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (47578cb4-3e6a-4d4d-8254-c68c557766b2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.387631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:03:30.388272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:30Z,description=,direction='egress',ethertype='IPv4',id=4afd4d82-7b94-4101-a545-772bf26e7089,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e97fa3e253f435d817619feeeb5260c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a,updated_at=2022-10-23T01:03:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:30.388639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (4afd4d82-7b94-4101-a545-772bf26e7089), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.388980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:03:30.390948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:30Z,description=,direction='ingress',ethertype='IPv6',id=66b9b2fe-7dca-490a-8c21-21bfaaec6276,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e97fa3e253f435d817619feeeb5260c',protocol=,remote_address_group_id=,remote_group_id=49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a,remote_ip_prefix=,revision_number=0,security_group_id=49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a,updated_at=2022-10-23T01:03:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:30.391866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (66b9b2fe-7dca-490a-8c21-21bfaaec6276), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.392533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:03:30.538467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T01:03:30Z,description='',dns_domain=None,id=320914bd-cd74-49c1-ba25-abce6f5b5bb0,mtu=1500,name='tempest-VolumesSnapshotTestJSON-2060016602-network',project_id='7e97fa3e253f435d817619feeeb5260c',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(320914bd-cd74-49c1-ba25-abce6f5b5bb0),segments=[NetworkSegment(b563694c-9507-42fa-99e2-76cd749180fe)],shared=False,status='ACTIVE',updated_at=2022-10-23T01:03:30Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:30.539111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (320914bd-cd74-49c1-ba25-abce6f5b5bb0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-0b1da4ca-ec6b-499c-99b0-ad3ac7f7a6c4 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 320914bd-cd74-49c1-ba25-abce6f5b5bb0 with segmentation id not found. Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 01:03:30.615761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 01:03:30.616891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 01:03:30.616891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 01:03:30.616891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 01:03:30.616891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 320914bd-cd74-49c1-ba25-abce6f5b5bb0 with segmentation id not found. Oct 23 01:03:30.616891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 01:03:30.812882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6e5cfa21-1cb1-463c-8d1c-0ed0863826ee admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4949f17b-8ec8-4f4a-9f87-4bc2fc26f1b9)],cidr=172.20.0.0/28,created_at=2022-10-23T01:03:30Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=37b3d7c1-3c96-497f-85f7-97891ad8144a,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesSnapshotTestJSON-2060016602-subnet',network_id=320914bd-cd74-49c1-ba25-abce6f5b5bb0,project_id='7e97fa3e253f435d817619feeeb5260c',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T01:03:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:30.813444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6e5cfa21-1cb1-463c-8d1c-0ed0863826ee admin admin] Publish callbacks [] for Subnet (37b3d7c1-3c96-497f-85f7-97891ad8144a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:32.127883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:478 started Oct 23 01:03:32.130478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=201000000,duration_sec=973,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:32.131297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:32.131656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:478 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:34.129666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:479 started Oct 23 01:03:34.133772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=203000000,duration_sec=975,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:34.134831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:34.135430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:479 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:03:34.893607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a8508183-9d9c-4f02-b5cb-d3b36a45fad4 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:03:34Z,data_plane_status=None,description='',device_id='c6604a0a-36f6-4e8f-8778-3de50fc8567c',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=504955ff-e836-4799-b7e1-cc6ef0b2261b,mac_address=fa:16:3e:de:59:42,name='',network_id=320914bd-cd74-49c1-ba25-abce6f5b5bb0,numa_affinity_policy=,project_id='7e97fa3e253f435d817619feeeb5260c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(504955ff-e836-4799-b7e1-cc6ef0b2261b),security_group_ids=set([49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a]),status='DOWN',updated_at=2022-10-23T01:03:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:34.894215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a8508183-9d9c-4f02-b5cb-d3b36a45fad4 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (504955ff-e836-4799-b7e1-cc6ef0b2261b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:34.894673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a8508183-9d9c-4f02-b5cb-d3b36a45fad4 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Security group member updated {'49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'} Oct 23 01:03:35.399332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dadfd542-d549-46ed-a115-608286e58df3 service neutron] Resource Port 504955ff-e836-4799-b7e1-cc6ef0b2261b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=504955ff-e836-4799-b7e1-cc6ef0b2261b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=504955ff-e836-4799-b7e1-cc6ef0b2261b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:35.400035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dadfd542-d549-46ed-a115-608286e58df3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (504955ff-e836-4799-b7e1-cc6ef0b2261b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:35.807730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dadfd542-d549-46ed-a115-608286e58df3 service neutron] Resource Port 504955ff-e836-4799-b7e1-cc6ef0b2261b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=504955ff-e836-4799-b7e1-cc6ef0b2261b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=504955ff-e836-4799-b7e1-cc6ef0b2261b,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=504955ff-e836-4799-b7e1-cc6ef0b2261b,segment=NetworkSegment(b563694c-9507-42fa-99e2-76cd749180fe),segment_id=b563694c-9507-42fa-99e2-76cd749180fe)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:35.808179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dadfd542-d549-46ed-a115-608286e58df3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (504955ff-e836-4799-b7e1-cc6ef0b2261b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:36.130895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:480 started Oct 23 01:03:36.133562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=204000000,duration_sec=977,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:36.134138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:36.134666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:480 - starting polling. Elapsed:0.004 Oct 23 01:03:36.137104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:36.139814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:480 - port information retrieved. Elapsed:0.009 Oct 23 01:03:36.140166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:480 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:03:38.132254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:481 started Oct 23 01:03:38.136563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=206000000,duration_sec=979,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:38.137466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:38.138056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:481 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:03:38.991142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 504955ff-e836-4799-b7e1-cc6ef0b2261b updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:38.991673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (504955ff-e836-4799-b7e1-cc6ef0b2261b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:40.133027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:482 started Oct 23 01:03:40.135497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cdc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=206000000,duration_sec=981,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:40.136408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:40.136830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:482 - starting polling. Elapsed:0.004 Oct 23 01:03:40.139007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:40.142368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:482 - port information retrieved. Elapsed:0.010 Oct 23 01:03:40.142701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:482 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:03:41.009372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 504955ff-e836-4799-b7e1-cc6ef0b2261b updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:03:41.009843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (504955ff-e836-4799-b7e1-cc6ef0b2261b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.600601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:41Z,description='Default security group',id=d1b87e9c-c03c-4c3b-94c0-aeb89a9450de,is_default=True,name='default',project_id='7197436bc3374cca8f526f698471bdac',revision_number=1,rules=[SecurityGroupRule(6be5e216-8052-4719-9746-e3c22fbf0812),SecurityGroupRule(bd894074-40ea-42e6-bb01-7338fd78d2c8),SecurityGroupRule(c1b24bc5-23ba-4c56-9348-cb0ea4d4bdbb),SecurityGroupRule(d3b7a694-b71e-474e-b3d0-f1b12af77770)],shared=False,stateful=True,updated_at=2022-10-23T01:03:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:41.601265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (d1b87e9c-c03c-4c3b-94c0-aeb89a9450de), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.601626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:41Z,description=,direction='egress',ethertype='IPv6',id=6be5e216-8052-4719-9746-e3c22fbf0812,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7197436bc3374cca8f526f698471bdac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d1b87e9c-c03c-4c3b-94c0-aeb89a9450de,updated_at=2022-10-23T01:03:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:41.601992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6be5e216-8052-4719-9746-e3c22fbf0812), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.602328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:41.603016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:41Z,description=,direction='egress',ethertype='IPv4',id=bd894074-40ea-42e6-bb01-7338fd78d2c8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7197436bc3374cca8f526f698471bdac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d1b87e9c-c03c-4c3b-94c0-aeb89a9450de,updated_at=2022-10-23T01:03:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:41.603388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (bd894074-40ea-42e6-bb01-7338fd78d2c8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.603718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:41.604378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:41Z,description=,direction='ingress',ethertype='IPv6',id=c1b24bc5-23ba-4c56-9348-cb0ea4d4bdbb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7197436bc3374cca8f526f698471bdac',protocol=,remote_address_group_id=,remote_group_id=d1b87e9c-c03c-4c3b-94c0-aeb89a9450de,remote_ip_prefix=,revision_number=0,security_group_id=d1b87e9c-c03c-4c3b-94c0-aeb89a9450de,updated_at=2022-10-23T01:03:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:41.604753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c1b24bc5-23ba-4c56-9348-cb0ea4d4bdbb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.605072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:41.605737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:41Z,description=,direction='ingress',ethertype='IPv4',id=d3b7a694-b71e-474e-b3d0-f1b12af77770,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7197436bc3374cca8f526f698471bdac',protocol=,remote_address_group_id=,remote_group_id=d1b87e9c-c03c-4c3b-94c0-aeb89a9450de,remote_ip_prefix=,revision_number=0,security_group_id=d1b87e9c-c03c-4c3b-94c0-aeb89a9450de,updated_at=2022-10-23T01:03:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:41.606089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d3b7a694-b71e-474e-b3d0-f1b12af77770), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.606427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b4e4fe78-546b-476e-9a82-cda8c77fda0b admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:41.741729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Resource SecurityGroup deleted: d1b87e9c-c03c-4c3b-94c0-aeb89a9450de {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:41.742378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (d1b87e9c-c03c-4c3b-94c0-aeb89a9450de), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.743520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d1b87e9c-c03c-4c3b-94c0-aeb89a9450de',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:41.758414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d1b87e9c-c03c-4c3b-94c0-aeb89a9450de',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:41.758934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Resource SecurityGroupRule deleted: 6be5e216-8052-4719-9746-e3c22fbf0812 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:41.759318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6be5e216-8052-4719-9746-e3c22fbf0812), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.759738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:41.760132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Resource SecurityGroupRule deleted: bd894074-40ea-42e6-bb01-7338fd78d2c8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:41.760498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (bd894074-40ea-42e6-bb01-7338fd78d2c8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.761183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:41.761561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Resource SecurityGroupRule deleted: c1b24bc5-23ba-4c56-9348-cb0ea4d4bdbb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:41.761929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c1b24bc5-23ba-4c56-9348-cb0ea4d4bdbb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.762227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:41.762620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Resource SecurityGroupRule deleted: d3b7a694-b71e-474e-b3d0-f1b12af77770 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:41.762955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d3b7a694-b71e-474e-b3d0-f1b12af77770), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:41.763278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-945ab406-5fb6-4819-ba1f-8698312b9de9 admin admin] Security group rule updated ['d1b87e9c-c03c-4c3b-94c0-aeb89a9450de'] Oct 23 01:03:42.134324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:483 started Oct 23 01:03:42.137489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=208000000,duration_sec=983,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:42.138191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:42.138598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:483 - starting polling. Elapsed:0.004 Oct 23 01:03:42.140955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.143748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:483 - port information retrieved. Elapsed:0.010 Oct 23 01:03:42.144393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:483 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:03:42.151987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:42Z,description='Default security group',id=dba43c3f-1783-42e9-993f-961ba5d3f16a,is_default=True,name='default',project_id='313d2246f39a4380846e492d82a282f7',revision_number=1,rules=[SecurityGroupRule(3407d979-a9e3-4657-a3d1-d100cae11641),SecurityGroupRule(9bf61117-e953-4fe6-846e-118b2a104e9b),SecurityGroupRule(befe6c87-770c-411e-9317-7b42af5e078d),SecurityGroupRule(c0fc5f31-921c-4d89-b516-3188f4789366)],shared=False,stateful=True,updated_at=2022-10-23T01:03:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:42.152447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (dba43c3f-1783-42e9-993f-961ba5d3f16a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.153155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:42Z,description=,direction='ingress',ethertype='IPv4',id=3407d979-a9e3-4657-a3d1-d100cae11641,normalized_cidr=None,port_range_max=,port_range_min=,project_id='313d2246f39a4380846e492d82a282f7',protocol=,remote_address_group_id=,remote_group_id=dba43c3f-1783-42e9-993f-961ba5d3f16a,remote_ip_prefix=,revision_number=0,security_group_id=dba43c3f-1783-42e9-993f-961ba5d3f16a,updated_at=2022-10-23T01:03:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:42.153514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (3407d979-a9e3-4657-a3d1-d100cae11641), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.153871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:42.154540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:42Z,description=,direction='egress',ethertype='IPv4',id=9bf61117-e953-4fe6-846e-118b2a104e9b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='313d2246f39a4380846e492d82a282f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dba43c3f-1783-42e9-993f-961ba5d3f16a,updated_at=2022-10-23T01:03:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:42.154888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9bf61117-e953-4fe6-846e-118b2a104e9b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.155217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:42.155860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:42Z,description=,direction='egress',ethertype='IPv6',id=befe6c87-770c-411e-9317-7b42af5e078d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='313d2246f39a4380846e492d82a282f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dba43c3f-1783-42e9-993f-961ba5d3f16a,updated_at=2022-10-23T01:03:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:42.156218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (befe6c87-770c-411e-9317-7b42af5e078d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.156529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:42.157205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:42Z,description=,direction='ingress',ethertype='IPv6',id=c0fc5f31-921c-4d89-b516-3188f4789366,normalized_cidr=None,port_range_max=,port_range_min=,project_id='313d2246f39a4380846e492d82a282f7',protocol=,remote_address_group_id=,remote_group_id=dba43c3f-1783-42e9-993f-961ba5d3f16a,remote_ip_prefix=,revision_number=0,security_group_id=dba43c3f-1783-42e9-993f-961ba5d3f16a,updated_at=2022-10-23T01:03:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:42.157548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c0fc5f31-921c-4d89-b516-3188f4789366), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.157872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-42fda689-b32a-4067-964e-d4548c0cea06 admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:42.295466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Resource SecurityGroup deleted: dba43c3f-1783-42e9-993f-961ba5d3f16a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:42.295827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (dba43c3f-1783-42e9-993f-961ba5d3f16a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.296446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dba43c3f-1783-42e9-993f-961ba5d3f16a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:42.310268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dba43c3f-1783-42e9-993f-961ba5d3f16a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:42.310705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Resource SecurityGroupRule deleted: 3407d979-a9e3-4657-a3d1-d100cae11641 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:42.311066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (3407d979-a9e3-4657-a3d1-d100cae11641), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.311385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:42.312050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Resource SecurityGroupRule deleted: 9bf61117-e953-4fe6-846e-118b2a104e9b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:42.312482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9bf61117-e953-4fe6-846e-118b2a104e9b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.313288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:42.313680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Resource SecurityGroupRule deleted: befe6c87-770c-411e-9317-7b42af5e078d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:42.314004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (befe6c87-770c-411e-9317-7b42af5e078d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.314316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:42.314677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Resource SecurityGroupRule deleted: c0fc5f31-921c-4d89-b516-3188f4789366 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:42.315032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c0fc5f31-921c-4d89-b516-3188f4789366), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:42.315340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-1b78bf92-cf8d-48ad-90cc-d79022b7666c admin admin] Security group rule updated ['dba43c3f-1783-42e9-993f-961ba5d3f16a'] Oct 23 01:03:43.718101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:43Z,description='Default security group',id=dea28569-442f-41b7-aa8e-2e6094052f83,is_default=True,name='default',project_id='956e44ee4a0e4bf39771fbea2bcf385e',revision_number=1,rules=[SecurityGroupRule(7d8b4d97-9539-46f6-b687-d48dabde9f5d),SecurityGroupRule(b932e934-cc99-4360-9960-aeaf3782864d),SecurityGroupRule(ce2a6794-742d-4740-9391-802aff4c0531),SecurityGroupRule(f6fb26b5-a44c-40b3-837d-b1084c8b6bd0)],shared=False,stateful=True,updated_at=2022-10-23T01:03:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:43.718649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (dea28569-442f-41b7-aa8e-2e6094052f83), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.719108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:43Z,description=,direction='ingress',ethertype='IPv4',id=7d8b4d97-9539-46f6-b687-d48dabde9f5d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='956e44ee4a0e4bf39771fbea2bcf385e',protocol=,remote_address_group_id=,remote_group_id=dea28569-442f-41b7-aa8e-2e6094052f83,remote_ip_prefix=,revision_number=0,security_group_id=dea28569-442f-41b7-aa8e-2e6094052f83,updated_at=2022-10-23T01:03:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:43.719489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7d8b4d97-9539-46f6-b687-d48dabde9f5d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.719813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:43.720537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:43Z,description=,direction='egress',ethertype='IPv6',id=b932e934-cc99-4360-9960-aeaf3782864d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='956e44ee4a0e4bf39771fbea2bcf385e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dea28569-442f-41b7-aa8e-2e6094052f83,updated_at=2022-10-23T01:03:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:43.720908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b932e934-cc99-4360-9960-aeaf3782864d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.721231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:43.722124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:43Z,description=,direction='ingress',ethertype='IPv6',id=ce2a6794-742d-4740-9391-802aff4c0531,normalized_cidr=None,port_range_max=,port_range_min=,project_id='956e44ee4a0e4bf39771fbea2bcf385e',protocol=,remote_address_group_id=,remote_group_id=dea28569-442f-41b7-aa8e-2e6094052f83,remote_ip_prefix=,revision_number=0,security_group_id=dea28569-442f-41b7-aa8e-2e6094052f83,updated_at=2022-10-23T01:03:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:43.722810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ce2a6794-742d-4740-9391-802aff4c0531), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.723126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:43.724003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:43Z,description=,direction='egress',ethertype='IPv4',id=f6fb26b5-a44c-40b3-837d-b1084c8b6bd0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='956e44ee4a0e4bf39771fbea2bcf385e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dea28569-442f-41b7-aa8e-2e6094052f83,updated_at=2022-10-23T01:03:43Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:43.724267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f6fb26b5-a44c-40b3-837d-b1084c8b6bd0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.724593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-800f11bc-7ca6-4695-8ed7-6f5d71423806 admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:43.865502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Resource SecurityGroup deleted: dea28569-442f-41b7-aa8e-2e6094052f83 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:43.865986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (dea28569-442f-41b7-aa8e-2e6094052f83), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.866703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dea28569-442f-41b7-aa8e-2e6094052f83',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:43.882597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dea28569-442f-41b7-aa8e-2e6094052f83',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:43.883235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Resource SecurityGroupRule deleted: 7d8b4d97-9539-46f6-b687-d48dabde9f5d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:43.883735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7d8b4d97-9539-46f6-b687-d48dabde9f5d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.884065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:43.884462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Resource SecurityGroupRule deleted: b932e934-cc99-4360-9960-aeaf3782864d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:43.884830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b932e934-cc99-4360-9960-aeaf3782864d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.885140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:43.885499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Resource SecurityGroupRule deleted: ce2a6794-742d-4740-9391-802aff4c0531 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:43.886201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ce2a6794-742d-4740-9391-802aff4c0531), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.886511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:43.886888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Resource SecurityGroupRule deleted: f6fb26b5-a44c-40b3-837d-b1084c8b6bd0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:43.887244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f6fb26b5-a44c-40b3-837d-b1084c8b6bd0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:43.887532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-19c846ee-7b85-4ffe-ae92-6294f2674a6a admin admin] Security group rule updated ['dea28569-442f-41b7-aa8e-2e6094052f83'] Oct 23 01:03:44.135132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:484 started Oct 23 01:03:44.141049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ce0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=210000000,duration_sec=985,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:44.141049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:44.141049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:484 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:03:46.136361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:485 started Oct 23 01:03:46.139423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ce2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=210000000,duration_sec=987,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:46.139949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:46.140263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:485 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:03:48.136817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:486 started Oct 23 01:03:48.140220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ce4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=211000000,duration_sec=989,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:48.140893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:48.141330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:486 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:03:48.361788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:03:48Z,description='Default security group',id=ba6d4f91-d208-4533-8cad-f6e939f62913,is_default=True,name='default',project_id='4ccf68fc217c41708c3c7c6cb31e14a6',revision_number=1,rules=[SecurityGroupRule(0b16fa18-870c-481b-a51c-5f0d1de5bb07),SecurityGroupRule(626897c5-7716-4bc1-afb4-3da6d5c1b2b2),SecurityGroupRule(9446c21a-d5f8-42b6-903f-5ce4dfdf29a8),SecurityGroupRule(dd74b311-023f-47e3-b2c3-a826eb2eda12)],shared=False,stateful=True,updated_at=2022-10-23T01:03:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:48.362362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (ba6d4f91-d208-4533-8cad-f6e939f62913), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.363038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:48Z,description=,direction='ingress',ethertype='IPv4',id=0b16fa18-870c-481b-a51c-5f0d1de5bb07,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4ccf68fc217c41708c3c7c6cb31e14a6',protocol=,remote_address_group_id=,remote_group_id=ba6d4f91-d208-4533-8cad-f6e939f62913,remote_ip_prefix=,revision_number=0,security_group_id=ba6d4f91-d208-4533-8cad-f6e939f62913,updated_at=2022-10-23T01:03:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:48.363489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0b16fa18-870c-481b-a51c-5f0d1de5bb07), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.364024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:48.364879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:48Z,description=,direction='ingress',ethertype='IPv6',id=626897c5-7716-4bc1-afb4-3da6d5c1b2b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4ccf68fc217c41708c3c7c6cb31e14a6',protocol=,remote_address_group_id=,remote_group_id=ba6d4f91-d208-4533-8cad-f6e939f62913,remote_ip_prefix=,revision_number=0,security_group_id=ba6d4f91-d208-4533-8cad-f6e939f62913,updated_at=2022-10-23T01:03:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:48.365253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (626897c5-7716-4bc1-afb4-3da6d5c1b2b2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.365639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:48.366357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:48Z,description=,direction='egress',ethertype='IPv4',id=9446c21a-d5f8-42b6-903f-5ce4dfdf29a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4ccf68fc217c41708c3c7c6cb31e14a6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ba6d4f91-d208-4533-8cad-f6e939f62913,updated_at=2022-10-23T01:03:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:48.366782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9446c21a-d5f8-42b6-903f-5ce4dfdf29a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.367154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:48.367959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:03:48Z,description=,direction='egress',ethertype='IPv6',id=dd74b311-023f-47e3-b2c3-a826eb2eda12,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4ccf68fc217c41708c3c7c6cb31e14a6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ba6d4f91-d208-4533-8cad-f6e939f62913,updated_at=2022-10-23T01:03:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:03:48.368475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (dd74b311-023f-47e3-b2c3-a826eb2eda12), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.368980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-954a4836-3e64-4f91-9fa8-392d680ee9f6 admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:48.508019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Resource SecurityGroup deleted: ba6d4f91-d208-4533-8cad-f6e939f62913 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:48.508496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (ba6d4f91-d208-4533-8cad-f6e939f62913), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.509071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ba6d4f91-d208-4533-8cad-f6e939f62913',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:03:48.523365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ba6d4f91-d208-4533-8cad-f6e939f62913',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:03:48.523838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Resource SecurityGroupRule deleted: 0b16fa18-870c-481b-a51c-5f0d1de5bb07 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:48.524193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0b16fa18-870c-481b-a51c-5f0d1de5bb07), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.524527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:48.524952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Resource SecurityGroupRule deleted: 626897c5-7716-4bc1-afb4-3da6d5c1b2b2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:48.525442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (626897c5-7716-4bc1-afb4-3da6d5c1b2b2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.525672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:48.526245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Resource SecurityGroupRule deleted: 9446c21a-d5f8-42b6-903f-5ce4dfdf29a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:48.526515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9446c21a-d5f8-42b6-903f-5ce4dfdf29a8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.526826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:48.527237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Resource SecurityGroupRule deleted: dd74b311-023f-47e3-b2c3-a826eb2eda12 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:03:48.527571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (dd74b311-023f-47e3-b2c3-a826eb2eda12), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:03:48.527892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-96caae91-603b-4158-b320-3e987cc7adac admin admin] Security group rule updated ['ba6d4f91-d208-4533-8cad-f6e939f62913'] Oct 23 01:03:50.137585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:487 started Oct 23 01:03:50.140467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ce6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=211000000,duration_sec=991,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:50.141090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:50.141554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:487 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:52.138421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:488 started Oct 23 01:03:52.141199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ce8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=212000000,duration_sec=993,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:52.141798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:52.142157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:488 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:54.139467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:489 started Oct 23 01:03:54.142411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=213000000,duration_sec=995,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:54.143044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:54.143387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:489 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:56.140521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:490 started Oct 23 01:03:56.143126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=214000000,duration_sec=997,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:56.143708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:56.144063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:490 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:03:58.141939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:491 started Oct 23 01:03:58.144559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=215000000,duration_sec=999,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:03:58.145183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:03:58.145542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:491 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:04:00.143544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:492 started Oct 23 01:04:00.146392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cf0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=217000000,duration_sec=1001,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:00.146824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:00.147181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:492 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:04:02.144192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:493 started Oct 23 01:04:02.147293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cf2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=218000000,duration_sec=1003,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:02.147990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:02.148374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:493 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:04:04.145001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:494 started Oct 23 01:04:04.149763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cf4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=219000000,duration_sec=1005,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:04.150800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:04.151626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:494 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:04:06.146702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:495 started Oct 23 01:04:06.150988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cf6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=220000000,duration_sec=1007,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:06.151940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:06.152503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:495 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:04:08.147853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:496 started Oct 23 01:04:08.150711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cf8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=221000000,duration_sec=1009,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:08.151391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:08.152060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:496 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:04:10.149609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:497 started Oct 23 01:04:10.153722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cfa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=223000000,duration_sec=1011,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:10.154667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:10.155245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:497 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:04:12.151008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:498 started Oct 23 01:04:12.155205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cfc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=225000000,duration_sec=1013,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:12.155920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:12.156357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:498 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:04:14.151945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:499 started Oct 23 01:04:14.154589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2cfe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=225000000,duration_sec=1015,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:14.155157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:14.155552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:499 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:04:16.153130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:500 started Oct 23 01:04:16.157711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=227000000,duration_sec=1017,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:16.158633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:16.159203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:500 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:04:16.904931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f060d9d8-58fc-4cd6-8902-37ebd17534e7 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port deleted: cb694e89-2b2a-42ab-ab86-e7168d28241c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:16.905314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f060d9d8-58fc-4cd6-8902-37ebd17534e7 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (cb694e89-2b2a-42ab-ab86-e7168d28241c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:18.154118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:501 started Oct 23 01:04:18.157148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=228000000,duration_sec=1019,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:18.157749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:18.158055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:501 - starting polling. Elapsed:0.004 Oct 23 01:04:18.160711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:18.162450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port cb694e89-2b2a-42ab-ab86-e7168d28241c not present in bridge br-int Oct 23 01:04:18.162785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:18.163070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['cb694e89-2b2a-42ab-ab86-e7168d28241c'] Oct 23 01:04:18.163391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port cb694e89-2b2a-42ab-ab86-e7168d28241c is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:18.166328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:501 - port information retrieved. Elapsed:0.013 Oct 23 01:04:18.167002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:501 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 01:04:20.155483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:502 started Oct 23 01:04:20.159603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=229000000,duration_sec=1021,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:20.160646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:20.161284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:502 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:04:22.156565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:503 started Oct 23 01:04:22.160101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=230000000,duration_sec=1023,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:22.160825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:22.161454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:503 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:04:23.023713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-886a9c11-8846-4a43-a225-03723534e868 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port deleted: e58dd85b-78b4-42cc-babe-3cd25e0a2c9a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:23.024093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-886a9c11-8846-4a43-a225-03723534e868 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (e58dd85b-78b4-42cc-babe-3cd25e0a2c9a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:23.024528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-886a9c11-8846-4a43-a225-03723534e868 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group member updated {'9e47da15-b648-4e05-8264-514053b0be27'} Oct 23 01:04:24.157742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:504 started Oct 23 01:04:24.160848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=231000000,duration_sec=1025,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:24.161393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:24.161858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:504 - starting polling. Elapsed:0.004 Oct 23 01:04:24.164266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:24.165744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port e58dd85b-78b4-42cc-babe-3cd25e0a2c9a not present in bridge br-int Oct 23 01:04:24.166083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:24.166371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['e58dd85b-78b4-42cc-babe-3cd25e0a2c9a'] Oct 23 01:04:24.166726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port e58dd85b-78b4-42cc-babe-3cd25e0a2c9a is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:24.169337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:504 - port information retrieved. Elapsed:0.012 Oct 23 01:04:24.169713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:504 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 01:04:26.159267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:505 started Oct 23 01:04:26.163363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=233000000,duration_sec=1027,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:26.164195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:26.164681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:505 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:04:28.160175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:506 started Oct 23 01:04:28.165664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=235000000,duration_sec=1029,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:28.166432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:28.166853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:506 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:04:29.898163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f42a0fba-6459-43f9-879b-57bf30345924 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port deleted: 0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:29.898803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f42a0fba-6459-43f9-879b-57bf30345924 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:30.161680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:507 started Oct 23 01:04:30.164423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=235000000,duration_sec=1031,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:30.165278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:30.165417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:507 - starting polling. Elapsed:0.004 Oct 23 01:04:30.167454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:30.168892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e not present in bridge br-int Oct 23 01:04:30.169228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:30.169532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e'] Oct 23 01:04:30.169859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0f44df3f-9ab7-4ef8-a114-4ca9c4145c7e is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:30.172571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:507 - port information retrieved. Elapsed:0.011 Oct 23 01:04:30.172928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:507 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:04:32.163065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:508 started Oct 23 01:04:32.165934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=237000000,duration_sec=1033,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:32.166609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:32.166948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:508 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:04:33.395217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:04:33Z,description='Default security group',id=91e5bbdb-8b77-423d-a999-23ae79cb5653,is_default=True,name='default',project_id='734b54d221c547a9a7e321861eec35e6',revision_number=1,rules=[SecurityGroupRule(03dfca6e-ce6b-4689-a379-ababd5db71e0),SecurityGroupRule(491f7d1c-1f01-4cf8-a459-f424f82c4293),SecurityGroupRule(792dd4f7-c114-4319-ad7d-cde89cb53e98),SecurityGroupRule(f9d0bbb2-cf7b-4b0f-8529-6993f6c62a03)],shared=False,stateful=True,updated_at=2022-10-23T01:04:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:33.396320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (91e5bbdb-8b77-423d-a999-23ae79cb5653), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.397150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:33Z,description=,direction='ingress',ethertype='IPv4',id=03dfca6e-ce6b-4689-a379-ababd5db71e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='734b54d221c547a9a7e321861eec35e6',protocol=,remote_address_group_id=,remote_group_id=91e5bbdb-8b77-423d-a999-23ae79cb5653,remote_ip_prefix=,revision_number=0,security_group_id=91e5bbdb-8b77-423d-a999-23ae79cb5653,updated_at=2022-10-23T01:04:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:33.397507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (03dfca6e-ce6b-4689-a379-ababd5db71e0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.397841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.398503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:33Z,description=,direction='egress',ethertype='IPv6',id=491f7d1c-1f01-4cf8-a459-f424f82c4293,normalized_cidr=None,port_range_max=,port_range_min=,project_id='734b54d221c547a9a7e321861eec35e6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91e5bbdb-8b77-423d-a999-23ae79cb5653,updated_at=2022-10-23T01:04:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:33.398868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (491f7d1c-1f01-4cf8-a459-f424f82c4293), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.399239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.399896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:33Z,description=,direction='ingress',ethertype='IPv6',id=792dd4f7-c114-4319-ad7d-cde89cb53e98,normalized_cidr=None,port_range_max=,port_range_min=,project_id='734b54d221c547a9a7e321861eec35e6',protocol=,remote_address_group_id=,remote_group_id=91e5bbdb-8b77-423d-a999-23ae79cb5653,remote_ip_prefix=,revision_number=0,security_group_id=91e5bbdb-8b77-423d-a999-23ae79cb5653,updated_at=2022-10-23T01:04:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:33.400228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (792dd4f7-c114-4319-ad7d-cde89cb53e98), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.400579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.401247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:33Z,description=,direction='egress',ethertype='IPv4',id=f9d0bbb2-cf7b-4b0f-8529-6993f6c62a03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='734b54d221c547a9a7e321861eec35e6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91e5bbdb-8b77-423d-a999-23ae79cb5653,updated_at=2022-10-23T01:04:33Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:33.402360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f9d0bbb2-cf7b-4b0f-8529-6993f6c62a03), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.402689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdca70f6-f586-44c4-91d4-47e2cc82401e admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.532009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Resource SecurityGroup deleted: 91e5bbdb-8b77-423d-a999-23ae79cb5653 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:33.532495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (91e5bbdb-8b77-423d-a999-23ae79cb5653), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.533137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('91e5bbdb-8b77-423d-a999-23ae79cb5653',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:04:33.549199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('91e5bbdb-8b77-423d-a999-23ae79cb5653',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:04:33.549847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Resource SecurityGroupRule deleted: 03dfca6e-ce6b-4689-a379-ababd5db71e0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:33.550366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (03dfca6e-ce6b-4689-a379-ababd5db71e0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.550816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.551461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Resource SecurityGroupRule deleted: 491f7d1c-1f01-4cf8-a459-f424f82c4293 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:33.551878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (491f7d1c-1f01-4cf8-a459-f424f82c4293), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.552524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.552821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Resource SecurityGroupRule deleted: 792dd4f7-c114-4319-ad7d-cde89cb53e98 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:33.553290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (792dd4f7-c114-4319-ad7d-cde89cb53e98), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.553604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.554193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Resource SecurityGroupRule deleted: f9d0bbb2-cf7b-4b0f-8529-6993f6c62a03 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:33.554529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f9d0bbb2-cf7b-4b0f-8529-6993f6c62a03), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.554997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e626b3da-d620-4b06-9e71-200ae46d8932 admin admin] Security group rule updated ['91e5bbdb-8b77-423d-a999-23ae79cb5653'] Oct 23 01:04:33.979346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-46b0221b-b238-460a-ba3a-9644d5351509 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Resource Port deleted: 504955ff-e836-4799-b7e1-cc6ef0b2261b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:33.979724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-46b0221b-b238-460a-ba3a-9644d5351509 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (504955ff-e836-4799-b7e1-cc6ef0b2261b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:33.980129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-46b0221b-b238-460a-ba3a-9644d5351509 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Security group member updated {'49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'} Oct 23 01:04:34.082242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc0d4374-86cf-49f8-9ddf-c77faa6d2412 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port deleted: 3852bda4-a273-400c-a77a-8c3bd9a04a63 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:34.082744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc0d4374-86cf-49f8-9ddf-c77faa6d2412 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (3852bda4-a273-400c-a77a-8c3bd9a04a63), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:34.083159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-dc0d4374-86cf-49f8-9ddf-c77faa6d2412 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group member updated {'9e47da15-b648-4e05-8264-514053b0be27'} Oct 23 01:04:34.163693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:509 started Oct 23 01:04:34.166456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=237000000,duration_sec=1035,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:34.167041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:34.167373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:509 - starting polling. Elapsed:0.004 Oct 23 01:04:34.169495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:34.170919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 504955ff-e836-4799-b7e1-cc6ef0b2261b not present in bridge br-int Oct 23 01:04:34.171253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:34.172861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 3852bda4-a273-400c-a77a-8c3bd9a04a63 not present in bridge br-int Oct 23 01:04:34.173178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:34.173515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['504955ff-e836-4799-b7e1-cc6ef0b2261b', '3852bda4-a273-400c-a77a-8c3bd9a04a63'] Oct 23 01:04:34.173868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 504955ff-e836-4799-b7e1-cc6ef0b2261b is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:34.174350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 3852bda4-a273-400c-a77a-8c3bd9a04a63 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:34.177372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:509 - port information retrieved. Elapsed:0.014 Oct 23 01:04:34.177820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:509 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 01:04:36.164734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:510 started Oct 23 01:04:36.168608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=239000000,duration_sec=1037,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:36.169478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:36.170226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:510 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:04:36.176672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4dbbba68-4114-4cad-bdf7-2c2bcde6a3b7 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: 0b92dbda-db20-4405-91e4-52e1123c9209 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:36.177165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4dbbba68-4114-4cad-bdf7-2c2bcde6a3b7 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (0b92dbda-db20-4405-91e4-52e1123c9209), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:36.177504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4dbbba68-4114-4cad-bdf7-2c2bcde6a3b7 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'10988333-e444-48fc-819a-71f5dfcdf37d'} Oct 23 01:04:37.016766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6bb499bb-b419-4a7c-b1d0-3fab0d8f0388 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource Port deleted: 48775c5f-c233-451e-b0b1-c1b30cd592d6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:37.017381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6bb499bb-b419-4a7c-b1d0-3fab0d8f0388 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (48775c5f-c233-451e-b0b1-c1b30cd592d6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:38.166706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:511 started Oct 23 01:04:38.171560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=241000000,duration_sec=1039,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:38.173059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:38.173363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:511 - starting polling. Elapsed:0.007 Oct 23 01:04:38.176937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:38.179264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 48775c5f-c233-451e-b0b1-c1b30cd592d6 not present in bridge br-int Oct 23 01:04:38.179812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:38.181548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0b92dbda-db20-4405-91e4-52e1123c9209 not present in bridge br-int Oct 23 01:04:38.182042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:38.182390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['48775c5f-c233-451e-b0b1-c1b30cd592d6', '0b92dbda-db20-4405-91e4-52e1123c9209'] Oct 23 01:04:38.182722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 48775c5f-c233-451e-b0b1-c1b30cd592d6 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:38.183022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 0b92dbda-db20-4405-91e4-52e1123c9209 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:38.185629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:511 - port information retrieved. Elapsed:0.020 Oct 23 01:04:38.185965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:511 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 23 01:04:40.166954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:512 started Oct 23 01:04:40.169646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=241000000,duration_sec=1041,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:40.170292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:40.170701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:512 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:04:40.605013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroup deleted: 9e47da15-b648-4e05-8264-514053b0be27 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.605425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (9e47da15-b648-4e05-8264-514053b0be27), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.605879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9e47da15-b648-4e05-8264-514053b0be27',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:04:40.622912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9e47da15-b648-4e05-8264-514053b0be27',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:04:40.623351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: 0bbf6656-6764-471b-9da9-c538f1038aa1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.623697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0bbf6656-6764-471b-9da9-c538f1038aa1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.624022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:40.625186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: 54834ade-103f-4850-b396-8593777cad04 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.625530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (54834ade-103f-4850-b396-8593777cad04), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.625838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:40.626314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: bdc02f66-b6d9-40a1-a307-6aa31e5a8cc5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.626996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (bdc02f66-b6d9-40a1-a307-6aa31e5a8cc5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.627316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:40.627921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: 0d89d567-c52f-479c-aae9-73910f67da9c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.628316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0d89d567-c52f-479c-aae9-73910f67da9c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.628593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:40.628940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: e0d763a5-2d2d-4505-a9b9-c59f63db2720 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.629418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e0d763a5-2d2d-4505-a9b9-c59f63db2720), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.629730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:40.630166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: 42cf54b2-e8bc-4221-a905-dbf2de8c63fc {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.630535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (42cf54b2-e8bc-4221-a905-dbf2de8c63fc), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.630842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:40.631236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: 40a90e16-46e5-4ef6-82a4-2e066713ec59 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.640780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (40a90e16-46e5-4ef6-82a4-2e066713ec59), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.640780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:40.640780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Resource SecurityGroupRule deleted: 7c025a3d-fbfd-46cc-bc68-8058230f8c29 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:40.640780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7c025a3d-fbfd-46cc-bc68-8058230f8c29), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:40.641416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bfb5ff6b-dd4e-46f4-be10-c3c669e34091 tempest-TestVolumeBootPattern-274362475 tempest-TestVolumeBootPattern-274362475-project] Security group rule updated ['9e47da15-b648-4e05-8264-514053b0be27'] Oct 23 01:04:41.266015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroup deleted: 10988333-e444-48fc-819a-71f5dfcdf37d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:41.266733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (10988333-e444-48fc-819a-71f5dfcdf37d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.267266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('10988333-e444-48fc-819a-71f5dfcdf37d',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:04:41.289843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('10988333-e444-48fc-819a-71f5dfcdf37d',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:04:41.290410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: e4fe3607-b6f3-45a8-93c0-c89e5d0f816d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:41.291585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e4fe3607-b6f3-45a8-93c0-c89e5d0f816d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.291993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:04:41.292450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: e5f661da-b8d8-4178-a94f-680c4cd56098 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:41.293388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e5f661da-b8d8-4178-a94f-680c4cd56098), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.293892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:04:41.295287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: fdb43a8f-8a26-4002-807e-f3575633edd9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:41.295865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fdb43a8f-8a26-4002-807e-f3575633edd9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.296765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:04:41.297429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 4a6223f2-7943-46ef-9620-5ff68d6a03af {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:41.298004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4a6223f2-7943-46ef-9620-5ff68d6a03af), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.298627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d93d7612-df1c-4ee6-b8dd-0e2a86fdf557 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['10988333-e444-48fc-819a-71f5dfcdf37d'] Oct 23 01:04:41.675659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c0f7389a-e318-47df-8ba3-d3474818c003 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: 6f04c088-4b2e-434b-b8ee-92c77bf7300e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:41.681427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c0f7389a-e318-47df-8ba3-d3474818c003 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (6f04c088-4b2e-434b-b8ee-92c77bf7300e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.968673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:04:41Z,description='tempest-description--658618554',id=33d5c0e5-8009-4147-b50c-1cd4826f080d,is_default=False,name='tempest-securitygroup--2031302748',project_id='3fae115d5ad049b5b40c59212216d458',revision_number=1,rules=[SecurityGroupRule(1b74278e-a3ec-4923-958e-6d2628bc8533),SecurityGroupRule(332962fe-df1b-4b93-9e76-8e79946ea3ad)],shared=False,stateful=True,updated_at=2022-10-23T01:04:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:41.969141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (33d5c0e5-8009-4147-b50c-1cd4826f080d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.969768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:41Z,description=,direction='egress',ethertype='IPv4',id=1b74278e-a3ec-4923-958e-6d2628bc8533,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=33d5c0e5-8009-4147-b50c-1cd4826f080d,updated_at=2022-10-23T01:04:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:41.970190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1b74278e-a3ec-4923-958e-6d2628bc8533), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.970530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:04:41.971203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:41Z,description=,direction='egress',ethertype='IPv6',id=332962fe-df1b-4b93-9e76-8e79946ea3ad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=33d5c0e5-8009-4147-b50c-1cd4826f080d,updated_at=2022-10-23T01:04:41Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:41.971563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (332962fe-df1b-4b93-9e76-8e79946ea3ad), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:41.971892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-05fed29a-d47d-4495-bdc3-6ec7a0738e41 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:04:42.037517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4e500529-8585-4b9b-90ad-54dc1d6615ce admin admin] Resource Port deleted: 7e98a342-e446-43cd-a9ad-e1e77aed3807 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:42.037920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4e500529-8585-4b9b-90ad-54dc1d6615ce admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (7e98a342-e446-43cd-a9ad-e1e77aed3807), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:42.114303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b7409ce0-a87b-437e-8ec2-1a0b13be2136 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:42Z,description='',direction='ingress',ethertype='IPv4',id=0da1dd84-c41c-4a4e-a8bd-e0145d32daea,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='3fae115d5ad049b5b40c59212216d458',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=33d5c0e5-8009-4147-b50c-1cd4826f080d,updated_at=2022-10-23T01:04:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:42.114938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b7409ce0-a87b-437e-8ec2-1a0b13be2136 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0da1dd84-c41c-4a4e-a8bd-e0145d32daea), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:42.115460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b7409ce0-a87b-437e-8ec2-1a0b13be2136 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:04:42.168037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:513 started Oct 23 01:04:42.172027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=242000000,duration_sec=1043,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:42.172707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:42.173393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:513 - starting polling. Elapsed:0.006 Oct 23 01:04:42.175754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:42.179094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e98a342-e4, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:04:42.191660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d1c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:42.193469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 6f04c088-4b2e-434b-b8ee-92c77bf7300e not present in bridge br-int Oct 23 01:04:42.194165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:42.194742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['7e98a342-e446-43cd-a9ad-e1e77aed3807', '6f04c088-4b2e-434b-b8ee-92c77bf7300e'] Oct 23 01:04:42.195297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 6f04c088-4b2e-434b-b8ee-92c77bf7300e is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:42.195823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:04:42.260387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7960cd8-f767-4849-8c6c-cd80f6937e23]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:04:42.266438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:513 - port information retrieved. Elapsed:0.099 Oct 23 01:04:42.268083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:513 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.100 Oct 23 01:04:42.320252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e95abf31-b463-44d6-b42b-a580c44785c1 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:42Z,description='',direction='ingress',ethertype='IPv4',id=e605c6a4-b2ee-499b-b6ac-cf651616e3e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3fae115d5ad049b5b40c59212216d458',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=33d5c0e5-8009-4147-b50c-1cd4826f080d,updated_at=2022-10-23T01:04:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:42.322869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e95abf31-b463-44d6-b42b-a580c44785c1 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e605c6a4-b2ee-499b-b6ac-cf651616e3e0), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:42.323292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e95abf31-b463-44d6-b42b-a580c44785c1 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:04:43.145532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b2ceecd2-1c4b-4a34-9f3a-3779b83c627f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:04:42Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9,mac_address=fa:16:3e:c6:ff:92,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:04:42Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:43.145912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b2ceecd2-1c4b-4a34-9f3a-3779b83c627f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:43.434717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ec61826d-8c97-4e94-81df-b3d654aabce3","delete","qr-7e98a342-e4",19,["map",[["attached-mac","fa:16:3e:dd:c5:dc"],["iface-id","7e98a342-e446-43cd-a9ad-e1e77aed3807"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:04:43.808085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b1401eae-ad57-4170-9156-c4f63afe539f","delete","qg-2b62c892-4a",20,["map",[["attached-mac","fa:16:3e:24:81:4b"],["iface-id","2b62c892-4abb-42c7-af27-c6803021dfdd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:04:44.014841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b2ceecd2-1c4b-4a34-9f3a-3779b83c627f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port 433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '94219bc5-a8e1-443b-92d8-2b916ad75925'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:44.015459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b2ceecd2-1c4b-4a34-9f3a-3779b83c627f tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:44.057125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c5b1389b-326f-4bb9-a237-c9d7a9d129c1 admin admin] Resource Port deleted: 2b62c892-4abb-42c7-af27-c6803021dfdd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:44.057615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c5b1389b-326f-4bb9-a237-c9d7a9d129c1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (2b62c892-4abb-42c7-af27-c6803021dfdd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:44.169496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:514 started Oct 23 01:04:44.174317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=244000000,duration_sec=1045,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:44.175372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:44.192996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:514 - starting polling. Elapsed:0.007 Oct 23 01:04:44.195056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:44.200549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d20,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:44.202786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d22,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:44.203104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:514 - port information retrieved. Elapsed:0.034 Oct 23 01:04:44.203438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f', '36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': set(), 'removed': {'7e98a342-e446-43cd-a9ad-e1e77aed3807', '2b62c892-4abb-42c7-af27-c6803021dfdd'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:04:44.203762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:514 - agent port security group processed in 0.000 Oct 23 01:04:44.209920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:04:44.210872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'7e98a342-e446-43cd-a9ad-e1e77aed3807', '2b62c892-4abb-42c7-af27-c6803021dfdd'} Oct 23 01:04:44.213741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 7e98a342-e446-43cd-a9ad-e1e77aed3807 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:44.214408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:04:44.284057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7cf5a9-7060-4e95-bac7-7a3dc45cd7e7]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:04:44.284888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'7e98a342-e446-43cd-a9ad-e1e77aed3807', '2b62c892-4abb-42c7-af27-c6803021dfdd'} removed Oct 23 01:04:44.344975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:04:44.345417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:44.345868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:514 - treat_devices_removed completed in 0.135 Oct 23 01:04:44.346228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:514 - ports processed. Elapsed:0.177 Oct 23 01:04:44.346622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:514 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.177 Oct 23 01:04:44.570694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7978a2fe-0fc3-412b-b813-405fd0778694 admin admin] Resource Subnet deleted: 6978021c-740e-4d5a-a551-8462e322d9a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:44.571244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7978a2fe-0fc3-412b-b813-405fd0778694 admin admin] Publish callbacks [] for Subnet (6978021c-740e-4d5a-a551-8462e322d9a8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:44.758295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0996e78c-947e-4bc9-b711-66442f5601b8","delete","tap8e19ef52-eb",18,["map",[["attached-mac","fa:16:3e:07:ff:aa"],["iface-id","8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:04:44.956002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-768d3f3d-3225-4d16-bf33-eb976ff3786c admin admin] Resource Port deleted: 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:44.956999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-768d3f3d-3225-4d16-bf33-eb976ff3786c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:45.108089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9ed71d66-fcb7-4185-a6aa-094bc1b7c799 None None] Resource Port deleted: 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:45.108089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9ed71d66-fcb7-4185-a6aa-094bc1b7c799 None None] Skipped duplicate delete event for 8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:04:45.256298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-768d3f3d-3225-4d16-bf33-eb976ff3786c admin admin] Resource Network deleted: 858cf055-6f06-45a9-bd3f-2b834e6b7b79 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:45.256956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-768d3f3d-3225-4d16-bf33-eb976ff3786c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (858cf055-6f06-45a9-bd3f-2b834e6b7b79), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:46.170846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:515 started Oct 23 01:04:46.173720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=244000000,duration_sec=1047,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:46.174323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:46.174750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:515 - starting polling. Elapsed:0.004 Oct 23 01:04:46.176586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:46.180255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d26,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:46.180565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:515 - port information retrieved. Elapsed:0.010 Oct 23 01:04:46.180927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '55c9d1b4-a571-45cb-ad61-6353c862fcd6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': set(), 'removed': {'8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:04:46.181312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:515 - agent port security group processed in 0.000 Oct 23 01:04:46.182817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:04:46.183118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f'} Oct 23 01:04:46.183558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:04:46.221498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6b0a09-c673-45cd-acef-4f17c58c8686]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:04:46.222093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'8e19ef52-eb7c-490c-b5d3-d40c46bfcd0f'} removed Oct 23 01:04:46.259860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a2822e0f-3191-44d0-ab01-bfb9409b5246 admin admin] Resource Port deleted: 55c9d1b4-a571-45cb-ad61-6353c862fcd6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:46.261392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a2822e0f-3191-44d0-ab01-bfb9409b5246 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (55c9d1b4-a571-45cb-ad61-6353c862fcd6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:46.262026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:04:46.262436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 8 from net-id = 858cf055-6f06-45a9-bd3f-2b834e6b7b79, seg-id = 383 Oct 23 01:04:46.265570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1321194b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:46.272149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2d28,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4479}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:46.272472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:515 - treat_devices_removed completed in 0.089 Oct 23 01:04:46.272751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:515 - ports processed. Elapsed:0.102 Oct 23 01:04:46.273399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:515 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.103 Oct 23 01:04:47.543746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:04:47Z,description='Default security group',id=9926de6b-0286-4175-a661-4d55c0217aca,is_default=True,name='default',project_id='b69a6c45d3f84fc785f3493facc35b43',revision_number=1,rules=[SecurityGroupRule(03efcf2c-4b5b-41ee-aabc-c71e90501496),SecurityGroupRule(1b79efe5-9915-43d4-a783-be8182817611),SecurityGroupRule(702457cc-31f2-47f9-8a1b-fad2b531a80b),SecurityGroupRule(a3fd76ad-cc98-4d2a-9fb6-d8795e8fc086)],shared=False,stateful=True,updated_at=2022-10-23T01:04:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:47.544911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (9926de6b-0286-4175-a661-4d55c0217aca), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.545711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:47Z,description=,direction='ingress',ethertype='IPv6',id=03efcf2c-4b5b-41ee-aabc-c71e90501496,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b69a6c45d3f84fc785f3493facc35b43',protocol=,remote_address_group_id=,remote_group_id=9926de6b-0286-4175-a661-4d55c0217aca,remote_ip_prefix=,revision_number=0,security_group_id=9926de6b-0286-4175-a661-4d55c0217aca,updated_at=2022-10-23T01:04:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:47.546240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (03efcf2c-4b5b-41ee-aabc-c71e90501496), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.546725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:47.547913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:47Z,description=,direction='egress',ethertype='IPv6',id=1b79efe5-9915-43d4-a783-be8182817611,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b69a6c45d3f84fc785f3493facc35b43',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9926de6b-0286-4175-a661-4d55c0217aca,updated_at=2022-10-23T01:04:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:47.548285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1b79efe5-9915-43d4-a783-be8182817611), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.548615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:47.549303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:47Z,description=,direction='egress',ethertype='IPv4',id=702457cc-31f2-47f9-8a1b-fad2b531a80b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b69a6c45d3f84fc785f3493facc35b43',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9926de6b-0286-4175-a661-4d55c0217aca,updated_at=2022-10-23T01:04:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:47.549652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (702457cc-31f2-47f9-8a1b-fad2b531a80b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.549971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:47.551161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:04:47Z,description=,direction='ingress',ethertype='IPv4',id=a3fd76ad-cc98-4d2a-9fb6-d8795e8fc086,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b69a6c45d3f84fc785f3493facc35b43',protocol=,remote_address_group_id=,remote_group_id=9926de6b-0286-4175-a661-4d55c0217aca,remote_ip_prefix=,revision_number=0,security_group_id=9926de6b-0286-4175-a661-4d55c0217aca,updated_at=2022-10-23T01:04:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:47.551514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a3fd76ad-cc98-4d2a-9fb6-d8795e8fc086), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.551834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-acb6f593-2d3a-4c9e-a39d-dbc8c5f19c13 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:47.780012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Resource SecurityGroup deleted: 9926de6b-0286-4175-a661-4d55c0217aca {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:47.780607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (9926de6b-0286-4175-a661-4d55c0217aca), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.781638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9926de6b-0286-4175-a661-4d55c0217aca',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:04:47.822488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9926de6b-0286-4175-a661-4d55c0217aca',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:04:47.823160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Resource SecurityGroupRule deleted: 03efcf2c-4b5b-41ee-aabc-c71e90501496 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:47.823265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (03efcf2c-4b5b-41ee-aabc-c71e90501496), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.823598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:47.823978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Resource SecurityGroupRule deleted: 1b79efe5-9915-43d4-a783-be8182817611 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:47.824308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1b79efe5-9915-43d4-a783-be8182817611), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.824616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:47.833949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Resource SecurityGroupRule deleted: 702457cc-31f2-47f9-8a1b-fad2b531a80b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:47.834495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (702457cc-31f2-47f9-8a1b-fad2b531a80b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.834972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:47.851166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Resource SecurityGroupRule deleted: a3fd76ad-cc98-4d2a-9fb6-d8795e8fc086 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:47.851795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a3fd76ad-cc98-4d2a-9fb6-d8795e8fc086), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:47.852139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-af6a1706-8748-4b73-b427-4270f1974b80 admin admin] Security group rule updated ['9926de6b-0286-4175-a661-4d55c0217aca'] Oct 23 01:04:48.172478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:516 started Oct 23 01:04:48.176045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=247000000,duration_sec=1049,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:48.177093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:48.177657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:516 - starting polling. Elapsed:0.006 Oct 23 01:04:48.180050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:48.184629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-55c9d1b4-a5, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:04:48.202731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d2c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:48.203652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['55c9d1b4-a571-45cb-ad61-6353c862fcd6'] Oct 23 01:04:48.204836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:04:48.262465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5dde12-777d-4c69-a5db-961fb7dfe613]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:04:48.265259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:516 - port information retrieved. Elapsed:0.093 Oct 23 01:04:48.265836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:516 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.094 Oct 23 01:04:48.399765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e90bcb96-d4b3-4a62-a069-904809d4e54b tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:04:47Z,data_plane_status=None,description='',device_id='9cac3dfe-3d48-4876-80e0-c86e7eb2a048',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f8fe8452-f530-4f16-a9d9-6ef8dc901a16,mac_address=fa:16:3e:fb:86:b5,name='',network_id=320914bd-cd74-49c1-ba25-abce6f5b5bb0,numa_affinity_policy=,project_id='7e97fa3e253f435d817619feeeb5260c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f8fe8452-f530-4f16-a9d9-6ef8dc901a16),security_group_ids=set([49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a]),status='DOWN',updated_at=2022-10-23T01:04:47Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:48.401270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e90bcb96-d4b3-4a62-a069-904809d4e54b tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f8fe8452-f530-4f16-a9d9-6ef8dc901a16), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:48.402144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e90bcb96-d4b3-4a62-a069-904809d4e54b tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Security group member updated {'49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'} Oct 23 01:04:48.697432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8fb24a18-dd4d-40fd-a2f3-33d8bd8a652b","delete","qr-55c9d1b4-a5",23,["map",[["attached-mac","fa:16:3e:4e:1d:29"],["iface-id","55c9d1b4-a571-45cb-ad61-6353c862fcd6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:04:48.750629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-1fbdcaa0-8196-4f9d-b398-aa85e8d39bd4 admin admin] Resource Port deleted: 0a49bf77-51b1-4891-aa10-f1dbb529cfe2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:48.751122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-1fbdcaa0-8196-4f9d-b398-aa85e8d39bd4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (0a49bf77-51b1-4891-aa10-f1dbb529cfe2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:48.813849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3a8063a6-5911-482c-9536-135d85401edd tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:04:47Z,data_plane_status=None,description='',device_id='1377f4b5-edc1-48c4-9e96-8fa7da42bc06',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=abdde47d-4bda-41f8-b373-ea74efd8c6ef,mac_address=fa:16:3e:8e:8a:a1,name='',network_id=fd218502-570d-4f7c-88c1-4499072d8f6e,numa_affinity_policy=,project_id='3fae115d5ad049b5b40c59212216d458',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(abdde47d-4bda-41f8-b373-ea74efd8c6ef),security_group_ids=set([33d5c0e5-8009-4147-b50c-1cd4826f080d]),status='DOWN',updated_at=2022-10-23T01:04:48Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:04:48.817164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3a8063a6-5911-482c-9536-135d85401edd tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (abdde47d-4bda-41f8-b373-ea74efd8c6ef), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:48.817902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3a8063a6-5911-482c-9536-135d85401edd tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'33d5c0e5-8009-4147-b50c-1cd4826f080d'} Oct 23 01:04:49.177156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8edbdde2-00e2-4515-94b1-4913af72fe52","delete","qg-0a49bf77-51",22,["map",[["attached-mac","fa:16:3e:67:f5:55"],["iface-id","0a49bf77-51b1-4891-aa10-f1dbb529cfe2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:04:49.281731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e1a3be00-0d74-4554-b525-fd9503f6fe73 admin admin] Resource Subnet deleted: 0fa7088a-c070-4968-8e67-305bb07f64cf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:49.282077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e1a3be00-0d74-4554-b525-fd9503f6fe73 admin admin] Publish callbacks [] for Subnet (0fa7088a-c070-4968-8e67-305bb07f64cf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:49.395542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-58ffa0f8-37f7-43be-91ce-cb03bd5d98b0 service neutron] Resource Port f8fe8452-f530-4f16-a9d9-6ef8dc901a16 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=f8fe8452-f530-4f16-a9d9-6ef8dc901a16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=f8fe8452-f530-4f16-a9d9-6ef8dc901a16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:49.397037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-58ffa0f8-37f7-43be-91ce-cb03bd5d98b0 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f8fe8452-f530-4f16-a9d9-6ef8dc901a16), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:49.423168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a89cc106-b716-4306-a51f-617bfa1f7adb","delete","tapcac42123-50",21,["map",[["attached-mac","fa:16:3e:fe:e7:63"],["iface-id","cac42123-50aa-4652-9152-a69ff5b9a35d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:04:49.669323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-612fe34b-7dfe-4d51-8379-15d7eee88821 admin admin] Resource Port deleted: cac42123-50aa-4652-9152-a69ff5b9a35d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:49.669703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-612fe34b-7dfe-4d51-8379-15d7eee88821 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (cac42123-50aa-4652-9152-a69ff5b9a35d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:49.826621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8686790d-228d-41f4-8e25-478d2983ee7a None None] Resource Port deleted: cac42123-50aa-4652-9152-a69ff5b9a35d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:49.827159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8686790d-228d-41f4-8e25-478d2983ee7a None None] Skipped duplicate delete event for cac42123-50aa-4652-9152-a69ff5b9a35d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:04:49.889886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-62eac228-15f9-482e-85cf-4e217fb58478 service neutron] Resource Port abdde47d-4bda-41f8-b373-ea74efd8c6ef updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=abdde47d-4bda-41f8-b373-ea74efd8c6ef,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=abdde47d-4bda-41f8-b373-ea74efd8c6ef,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:49.890794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-62eac228-15f9-482e-85cf-4e217fb58478 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (abdde47d-4bda-41f8-b373-ea74efd8c6ef), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:49.974700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-612fe34b-7dfe-4d51-8379-15d7eee88821 admin admin] Resource Network deleted: 3671536d-8aa1-44fa-b916-8136fb2fa9f6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:49.975340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-612fe34b-7dfe-4d51-8379-15d7eee88821 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (3671536d-8aa1-44fa-b916-8136fb2fa9f6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.050986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-58ffa0f8-37f7-43be-91ce-cb03bd5d98b0 service neutron] Resource Port f8fe8452-f530-4f16-a9d9-6ef8dc901a16 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=f8fe8452-f530-4f16-a9d9-6ef8dc901a16,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=f8fe8452-f530-4f16-a9d9-6ef8dc901a16,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=f8fe8452-f530-4f16-a9d9-6ef8dc901a16,segment=NetworkSegment(b563694c-9507-42fa-99e2-76cd749180fe),segment_id=b563694c-9507-42fa-99e2-76cd749180fe)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:50.051641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-58ffa0f8-37f7-43be-91ce-cb03bd5d98b0 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f8fe8452-f530-4f16-a9d9-6ef8dc901a16), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.173545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:517 started Oct 23 01:04:50.176678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=247000000,duration_sec=1051,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:50.177333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:50.177831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:517 - starting polling. Elapsed:0.005 Oct 23 01:04:50.181864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.185227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d30,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:50.187121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d32,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:50.189284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d34,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:50.189598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:517 - port information retrieved. Elapsed:0.016 Oct 23 01:04:50.189923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'8edb9f18-7960-4eae-89c3-6b941ce63ba3', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd', '36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': set(), 'removed': {'55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:04:50.190560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:517 - agent port security group processed in 0.000 Oct 23 01:04:50.191929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:04:50.192233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2'} Oct 23 01:04:50.192567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 55c9d1b4-a571-45cb-ad61-6353c862fcd6 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:04:50.193693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:04:50.245213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9f30a-99c0-45a6-897f-ab1de1e00071]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:04:50.245831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'55c9d1b4-a571-45cb-ad61-6353c862fcd6', 'cac42123-50aa-4652-9152-a69ff5b9a35d', '0a49bf77-51b1-4891-aa10-f1dbb529cfe2'} removed Oct 23 01:04:50.326852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:04:50.327282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:04:50.327692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 9 from net-id = 3671536d-8aa1-44fa-b916-8136fb2fa9f6, seg-id = 381 Oct 23 01:04:50.330486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1321194d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:50.332897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2d36,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4477}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:50.333437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:517 - treat_devices_removed completed in 0.141 Oct 23 01:04:50.333926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:517 - ports processed. Elapsed:0.160 Oct 23 01:04:50.334343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:517 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.161 Oct 23 01:04:50.355701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Resource SecurityGroup deleted: c2046e9a-95a0-4c55-917f-3d9a7035dab5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.356409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (c2046e9a-95a0-4c55-917f-3d9a7035dab5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.357131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c2046e9a-95a0-4c55-917f-3d9a7035dab5',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:04:50.375489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c2046e9a-95a0-4c55-917f-3d9a7035dab5',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:04:50.375937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Resource SecurityGroupRule deleted: 07520b25-2967-4f6e-9262-033f016855f5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.376487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (07520b25-2967-4f6e-9262-033f016855f5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.376856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 01:04:50.377588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Resource SecurityGroupRule deleted: 5041ad21-1fe7-4682-b4a0-5ec1e06c1cc4 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.377981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5041ad21-1fe7-4682-b4a0-5ec1e06c1cc4), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.378301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 01:04:50.378667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Resource SecurityGroupRule deleted: 6426534e-9e2c-4cd8-bf2a-1586851ce11c {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.379006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6426534e-9e2c-4cd8-bf2a-1586851ce11c), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.379316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 01:04:50.379675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Resource SecurityGroupRule deleted: ddbb787d-d0f9-4228-8dfe-9499e25dbbc2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.380006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ddbb787d-d0f9-4228-8dfe-9499e25dbbc2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.380305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-a29aef50-9369-4f14-9608-4f78c4d6bb06 admin admin] Security group rule updated ['c2046e9a-95a0-4c55-917f-3d9a7035dab5'] Oct 23 01:04:50.902979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Resource SecurityGroup deleted: fc42b5e2-044d-4a87-a887-aeaedf9f364b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.903636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (fc42b5e2-044d-4a87-a887-aeaedf9f364b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.904250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fc42b5e2-044d-4a87-a887-aeaedf9f364b',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:04:50.917361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fc42b5e2-044d-4a87-a887-aeaedf9f364b',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:04:50.918304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Resource SecurityGroupRule deleted: 43a2cb01-f028-477d-930d-3573b4ac2f2e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.919149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (43a2cb01-f028-477d-930d-3573b4ac2f2e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.919921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 01:04:50.920512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Resource SecurityGroupRule deleted: 794530a2-b611-4e00-80aa-f266357c983d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.921077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (794530a2-b611-4e00-80aa-f266357c983d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.921632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 01:04:50.922092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Resource SecurityGroupRule deleted: 7d60977d-db40-4040-abd7-1af2e14a1bf8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.923164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7d60977d-db40-4040-abd7-1af2e14a1bf8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.923633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 01:04:50.924269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Resource SecurityGroupRule deleted: e5680287-6a7b-47f5-a9cf-479bac3362cf {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:04:50.924885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e5680287-6a7b-47f5-a9cf-479bac3362cf), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:50.925289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-29f94b7a-834a-4443-8227-997b044628fd admin admin] Security group rule updated ['fc42b5e2-044d-4a87-a887-aeaedf9f364b'] Oct 23 01:04:50.987609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-62eac228-15f9-482e-85cf-4e217fb58478 service neutron] Resource Port abdde47d-4bda-41f8-b373-ea74efd8c6ef updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=abdde47d-4bda-41f8-b373-ea74efd8c6ef,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=abdde47d-4bda-41f8-b373-ea74efd8c6ef,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=abdde47d-4bda-41f8-b373-ea74efd8c6ef,segment=NetworkSegment(e963d26c-0a32-4372-aefd-3f9403fc219c),segment_id=e963d26c-0a32-4372-aefd-3f9403fc219c)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:50.988061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-62eac228-15f9-482e-85cf-4e217fb58478 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (abdde47d-4bda-41f8-b373-ea74efd8c6ef), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:52.174553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:518 started Oct 23 01:04:52.177257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=248000000,duration_sec=1053,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:52.177851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:52.179283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:518 - starting polling. Elapsed:0.005 Oct 23 01:04:52.180673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:52.182556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:518 - port information retrieved. Elapsed:0.009 Oct 23 01:04:52.182889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:518 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:04:52.349642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port f8fe8452-f530-4f16-a9d9-6ef8dc901a16 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:52.350036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f8fe8452-f530-4f16-a9d9-6ef8dc901a16), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:54.175017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:519 started Oct 23 01:04:54.178047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=249000000,duration_sec=1055,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:54.178724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:54.179129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:519 - starting polling. Elapsed:0.004 Oct 23 01:04:54.180776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:54.182743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:519 - port information retrieved. Elapsed:0.008 Oct 23 01:04:54.183141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:519 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:04:54.473797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port abdde47d-4bda-41f8-b373-ea74efd8c6ef updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:54.474146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (abdde47d-4bda-41f8-b373-ea74efd8c6ef), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:54.523821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port f8fe8452-f530-4f16-a9d9-6ef8dc901a16 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:54.524192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (f8fe8452-f530-4f16-a9d9-6ef8dc901a16), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:56.176448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:520 started Oct 23 01:04:56.181030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=251000000,duration_sec=1057,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:56.181626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:56.182016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:520 - starting polling. Elapsed:0.006 Oct 23 01:04:56.183564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:56.185352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:520 - port information retrieved. Elapsed:0.009 Oct 23 01:04:56.185690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:520 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:04:56.350678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port abdde47d-4bda-41f8-b373-ea74efd8c6ef updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:04:56.351063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (abdde47d-4bda-41f8-b373-ea74efd8c6ef), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:58.177119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:521 started Oct 23 01:04:58.179926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=251000000,duration_sec=1059,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:04:58.180572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:04:58.181003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:521 - starting polling. Elapsed:0.004 Oct 23 01:04:58.182781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:04:58.184775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:521 - port information retrieved. Elapsed:0.008 Oct 23 01:04:58.185151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:521 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:05:00.177714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:522 started Oct 23 01:05:00.180351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=251000000,duration_sec=1061,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:00.180948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:00.181493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:522 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:02.178915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:523 started Oct 23 01:05:02.182172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=252000000,duration_sec=1063,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:02.182976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:02.183440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:523 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:05:04.179101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:524 started Oct 23 01:05:04.181730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=252000000,duration_sec=1065,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:04.182311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:04.182663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:524 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:06.180420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:525 started Oct 23 01:05:06.183157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=254000000,duration_sec=1067,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:06.183771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:06.184146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:525 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:08.182116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:526 started Oct 23 01:05:08.186620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=256000000,duration_sec=1069,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:08.187596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:08.188185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:526 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:05:10.182644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:527 started Oct 23 01:05:10.185265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=256000000,duration_sec=1071,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:10.185846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:10.186205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:527 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:12.183901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:528 started Oct 23 01:05:12.187447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=257000000,duration_sec=1073,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:12.188131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:12.188581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:528 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:05:14.184679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:529 started Oct 23 01:05:14.187220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=258000000,duration_sec=1075,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:14.187822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:14.188177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:529 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:16.185902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:530 started Oct 23 01:05:16.190026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=260000000,duration_sec=1077,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:16.191011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:16.191587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:530 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:05:17.438459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-87745957-175e-4e25-9e7f-33fc357df9c2 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Resource Port deleted: f8fe8452-f530-4f16-a9d9-6ef8dc901a16 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:17.439084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-87745957-175e-4e25-9e7f-33fc357df9c2 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (f8fe8452-f530-4f16-a9d9-6ef8dc901a16), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:17.439231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-87745957-175e-4e25-9e7f-33fc357df9c2 tempest-VolumesSnapshotTestJSON-306835930 tempest-VolumesSnapshotTestJSON-306835930-project] Security group member updated {'49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'} Oct 23 01:05:18.187337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:531 started Oct 23 01:05:18.190937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=261000000,duration_sec=1079,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:18.191681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:18.192092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:531 - starting polling. Elapsed:0.005 Oct 23 01:05:18.194903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:18.196819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port f8fe8452-f530-4f16-a9d9-6ef8dc901a16 not present in bridge br-int Oct 23 01:05:18.197489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:05:18.197947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['f8fe8452-f530-4f16-a9d9-6ef8dc901a16'] Oct 23 01:05:18.198600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port f8fe8452-f530-4f16-a9d9-6ef8dc901a16 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:05:18.200384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:531 - port information retrieved. Elapsed:0.014 Oct 23 01:05:18.200691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:531 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 23 01:05:20.188865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:532 started Oct 23 01:05:20.193110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=263000000,duration_sec=1081,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:20.193957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:20.194449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:532 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:05:22.189771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:533 started Oct 23 01:05:22.193914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=264000000,duration_sec=1083,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:22.194858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:22.195444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:533 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:05:24.190792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:534 started Oct 23 01:05:24.193532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=264000000,duration_sec=1085,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:24.194117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:24.194472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:534 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:26.192203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:535 started Oct 23 01:05:26.194809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=266000000,duration_sec=1087,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:26.195400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:26.195757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:535 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:28.194533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:536 started Oct 23 01:05:28.198707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=268000000,duration_sec=1089,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:28.199680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:28.200248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:536 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:05:30.195303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:537 started Oct 23 01:05:30.198448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=269000000,duration_sec=1091,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:30.199037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:30.199392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:537 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:32.196847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:538 started Oct 23 01:05:32.201591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=272000000,duration_sec=1093,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:32.202211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:32.202677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:538 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:05:34.197748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:539 started Oct 23 01:05:34.200662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=271000000,duration_sec=1095,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:34.202284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:34.202697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:539 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:05:36.198907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:540 started Oct 23 01:05:36.201830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=272000000,duration_sec=1097,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:36.203166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:36.203513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:540 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:05:38.199639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:541 started Oct 23 01:05:38.202215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=273000000,duration_sec=1099,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:38.202796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:38.203149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:541 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:40.200585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:542 started Oct 23 01:05:40.203859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=274000000,duration_sec=1101,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:40.204533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:40.205012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:542 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:05:40.693254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-40c73170-2e28-4c7c-bfc7-10bd1827eb79 admin admin] Resource Subnet deleted: 37b3d7c1-3c96-497f-85f7-97891ad8144a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:40.693621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-40c73170-2e28-4c7c-bfc7-10bd1827eb79 admin admin] Publish callbacks [] for Subnet (37b3d7c1-3c96-497f-85f7-97891ad8144a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:41.007768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-682cfe0d-c5d3-4c43-872e-be3d53c881a9 admin admin] Resource Network deleted: 320914bd-cd74-49c1-ba25-abce6f5b5bb0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:41.008264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-682cfe0d-c5d3-4c43-872e-be3d53c881a9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (320914bd-cd74-49c1-ba25-abce6f5b5bb0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:41.364128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Resource SecurityGroup deleted: 49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:41.365207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:41.365874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:05:41.381512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:05:41.382017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Resource SecurityGroupRule deleted: 0d860759-6279-4f80-bada-3b6f3c1368e1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:41.382549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0d860759-6279-4f80-bada-3b6f3c1368e1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:41.383542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:05:41.384008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Resource SecurityGroupRule deleted: 47578cb4-3e6a-4d4d-8254-c68c557766b2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:41.384473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (47578cb4-3e6a-4d4d-8254-c68c557766b2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:41.384905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:05:41.385366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Resource SecurityGroupRule deleted: 4afd4d82-7b94-4101-a545-772bf26e7089 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:41.385776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (4afd4d82-7b94-4101-a545-772bf26e7089), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:41.386503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:05:41.386933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Resource SecurityGroupRule deleted: 66b9b2fe-7dca-490a-8c21-21bfaaec6276 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:41.387334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (66b9b2fe-7dca-490a-8c21-21bfaaec6276), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:41.387711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-bb2b61e8-bc54-4032-8093-56b064bc2dbf admin admin] Security group rule updated ['49b43bf1-fb0c-4c2e-a26b-d2badbc5ce4a'] Oct 23 01:05:42.201780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:543 started Oct 23 01:05:42.205489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=275000000,duration_sec=1103,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:42.206372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:42.206872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:543 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:05:44.202962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:544 started Oct 23 01:05:44.205852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=277000000,duration_sec=1105,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:44.206443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:44.206884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:544 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:46.204118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:545 started Oct 23 01:05:46.206702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=277000000,duration_sec=1107,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:46.207284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:46.207633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:545 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:48.205105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:546 started Oct 23 01:05:48.208713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=279000000,duration_sec=1109,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:48.209706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:48.210267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:546 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:05:49.989864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4589099a-a23d-4c07-8603-2d1a127ec57d tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: abdde47d-4bda-41f8-b373-ea74efd8c6ef {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:49.990508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4589099a-a23d-4c07-8603-2d1a127ec57d tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (abdde47d-4bda-41f8-b373-ea74efd8c6ef), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:49.990621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4589099a-a23d-4c07-8603-2d1a127ec57d tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group member updated {'33d5c0e5-8009-4147-b50c-1cd4826f080d'} Oct 23 01:05:50.206441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:547 started Oct 23 01:05:50.210016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=280000000,duration_sec=1111,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:50.210536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:50.211221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:547 - starting polling. Elapsed:0.005 Oct 23 01:05:50.212385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:50.213787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port abdde47d-4bda-41f8-b373-ea74efd8c6ef not present in bridge br-int Oct 23 01:05:50.214111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:05:50.214449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['abdde47d-4bda-41f8-b373-ea74efd8c6ef'] Oct 23 01:05:50.214953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port abdde47d-4bda-41f8-b373-ea74efd8c6ef is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:05:50.216978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:547 - port information retrieved. Elapsed:0.011 Oct 23 01:05:50.217509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:547 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:05:51.617323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroup deleted: 33d5c0e5-8009-4147-b50c-1cd4826f080d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:51.617923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (33d5c0e5-8009-4147-b50c-1cd4826f080d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:51.618138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('33d5c0e5-8009-4147-b50c-1cd4826f080d',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:05:51.632016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('33d5c0e5-8009-4147-b50c-1cd4826f080d',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:05:51.632430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 1b74278e-a3ec-4923-958e-6d2628bc8533 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:51.632824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1b74278e-a3ec-4923-958e-6d2628bc8533), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:51.633147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:05:51.633538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 332962fe-df1b-4b93-9e76-8e79946ea3ad {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:51.633906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (332962fe-df1b-4b93-9e76-8e79946ea3ad), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:51.634228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:05:51.634615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: 0da1dd84-c41c-4a4e-a8bd-e0145d32daea {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:51.634946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0da1dd84-c41c-4a4e-a8bd-e0145d32daea), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:51.635388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:05:51.635773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource SecurityGroupRule deleted: e605c6a4-b2ee-499b-b6ac-cf651616e3e0 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:51.636544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e605c6a4-b2ee-499b-b6ac-cf651616e3e0), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:51.636889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-3e043552-2fde-4769-bfc8-3e8c3f7ba6a3 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Security group rule updated ['33d5c0e5-8009-4147-b50c-1cd4826f080d'] Oct 23 01:05:52.207331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:548 started Oct 23 01:05:52.210399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=281000000,duration_sec=1113,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:52.211019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:52.211384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:548 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:52.273940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4a639836-2240-48ed-98f0-f4f73f92d444 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Resource Port deleted: 433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:52.274321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4a639836-2240-48ed-98f0-f4f73f92d444 tempest-AttachVolumeNegativeTest-1875274982 tempest-AttachVolumeNegativeTest-1875274982-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:54.208141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:549 started Oct 23 01:05:54.210658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=281000000,duration_sec=1115,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:54.211234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:54.211564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:549 - starting polling. Elapsed:0.004 Oct 23 01:05:54.213109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:54.214072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9 not present in bridge br-int Oct 23 01:05:54.214392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:05:54.214694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9'] Oct 23 01:05:54.215010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 433d21b9-4c8d-4d8e-b7c0-eea8622f5ef9 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:05:54.216711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:549 - port information retrieved. Elapsed:0.009 Oct 23 01:05:54.217049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:549 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:05:56.209158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:550 started Oct 23 01:05:56.211751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=283000000,duration_sec=1117,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:56.212337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:56.212860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:550 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:05:57.454406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d51b7693-2b1d-49ea-b28a-a96c62a53a63 admin admin] Resource Port deleted: 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:57.454406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d51b7693-2b1d-49ea-b28a-a96c62a53a63 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (82ab6488-6b18-4ad8-b485-c6f52a5eacb2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:58.210819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:551 started Oct 23 01:05:58.214004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=284000000,duration_sec=1119,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:58.214859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:05:58.215227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:551 - starting polling. Elapsed:0.005 Oct 23 01:05:58.216828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:58.219492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-82ab6488-6b, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:05:58.233421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d7c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:05:58.233790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['82ab6488-6b18-4ad8-b485-c6f52a5eacb2'] Oct 23 01:05:58.234225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:05:58.297903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30656a-e42a-4ea7-a6ac-7abd135ee306]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:05:58.300027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:551 - port information retrieved. Elapsed:0.089 Oct 23 01:05:58.300362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:551 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.090 Oct 23 01:05:58.525003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4deef4e3-30f3-415e-9345-bcc1bbccbc8e admin admin] Resource Port deleted: ba4c44b3-597d-4a36-9e78-c7a4635964fd {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:58.526554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4deef4e3-30f3-415e-9345-bcc1bbccbc8e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (ba4c44b3-597d-4a36-9e78-c7a4635964fd), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:58.534510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["352ba784-1654-4b15-bd2e-61d84303f86d","delete","qr-82ab6488-6b",31,["map",[["attached-mac","fa:16:3e:e3:ba:1f"],["iface-id","82ab6488-6b18-4ad8-b485-c6f52a5eacb2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:05:58.938414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["10ee2916-7a08-4df8-be64-0558ff010e35","delete","qg-ba4c44b3-59",32,["map",[["attached-mac","fa:16:3e:55:9b:21"],["iface-id","ba4c44b3-597d-4a36-9e78-c7a4635964fd"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:05:59.028334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f1249def-9e04-484b-b6ef-034c109312de admin admin] Resource Subnet deleted: a9e16815-4336-4cda-ac3b-da5c9a06661d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.028709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f1249def-9e04-484b-b6ef-034c109312de admin admin] Publish callbacks [] for Subnet (a9e16815-4336-4cda-ac3b-da5c9a06661d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.141324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f64790f4-bc2e-416b-a41a-01a320308a3a","delete","tap8a9df9e6-17",30,["map",[["attached-mac","fa:16:3e:e6:7b:b0"],["iface-id","8a9df9e6-1791-4258-b31e-ff476bb28ac6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:05:59.331126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e5defb9e-aab5-4f76-afc8-78038debf031 admin admin] Resource Port deleted: 8a9df9e6-1791-4258-b31e-ff476bb28ac6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.331728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e5defb9e-aab5-4f76-afc8-78038debf031 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (8a9df9e6-1791-4258-b31e-ff476bb28ac6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.440095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50be4243-6cbc-43d8-a206-ea60812a57e1 None None] Resource Port deleted: 8a9df9e6-1791-4258-b31e-ff476bb28ac6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.440514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-50be4243-6cbc-43d8-a206-ea60812a57e1 None None] Skipped duplicate delete event for 8a9df9e6-1791-4258-b31e-ff476bb28ac6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:05:59.582529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e5defb9e-aab5-4f76-afc8-78038debf031 admin admin] Resource Network deleted: fd218502-570d-4f7c-88c1-4499072d8f6e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.583119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e5defb9e-aab5-4f76-afc8-78038debf031 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (fd218502-570d-4f7c-88c1-4499072d8f6e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.875921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Resource SecurityGroup deleted: 9ec11291-2020-40e6-b8e0-a810898f7a4a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.876302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (9ec11291-2020-40e6-b8e0-a810898f7a4a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.876782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9ec11291-2020-40e6-b8e0-a810898f7a4a',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:05:59.891356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9ec11291-2020-40e6-b8e0-a810898f7a4a',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:05:59.891886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Resource SecurityGroupRule deleted: 02f25ac1-7cd3-4d08-8177-6cf9731b5141 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.892304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (02f25ac1-7cd3-4d08-8177-6cf9731b5141), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.892759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:05:59.893262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Resource SecurityGroupRule deleted: 0abc49cc-7041-4d60-9466-db47163e78aa {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.893698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0abc49cc-7041-4d60-9466-db47163e78aa), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.894097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:05:59.894524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Resource SecurityGroupRule deleted: 473ba318-5e70-43e7-b438-9296ae08da65 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.894923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (473ba318-5e70-43e7-b438-9296ae08da65), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.895281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:05:59.895706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Resource SecurityGroupRule deleted: a6d41d69-0185-438f-b5ef-738e9676694d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:05:59.896101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a6d41d69-0185-438f-b5ef-738e9676694d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:05:59.896476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-9da024c5-5dfd-49a9-8f07-bbd6c53f4601 admin admin] Security group rule updated ['9ec11291-2020-40e6-b8e0-a810898f7a4a'] Oct 23 01:06:00.212264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:552 started Oct 23 01:06:00.214913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=286000000,duration_sec=1121,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:00.215620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:00.216097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:552 - starting polling. Elapsed:0.004 Oct 23 01:06:00.217591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:00.220517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d80,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:00.222488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d82,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:00.224263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2d84,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:00.224568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:552 - port information retrieved. Elapsed:0.012 Oct 23 01:06:00.224921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'8edb9f18-7960-4eae-89c3-6b941ce63ba3', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': set(), 'removed': {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:00.225282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:552 - agent port security group processed in 0.000 Oct 23 01:06:00.226246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:06:00.226647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd'} Oct 23 01:06:00.226862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 82ab6488-6b18-4ad8-b485-c6f52a5eacb2 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:06:00.227333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:00.266815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a1c42-f8c5-4bb8-b77b-7c1ceed3fd76]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:00.267466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'82ab6488-6b18-4ad8-b485-c6f52a5eacb2', '8a9df9e6-1791-4258-b31e-ff476bb28ac6', 'ba4c44b3-597d-4a36-9e78-c7a4635964fd'} removed Oct 23 01:06:00.334952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:06:00.335310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:06:00.335712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 12 from net-id = fd218502-570d-4f7c-88c1-4499072d8f6e, seg-id = 374 Oct 23 01:06:00.339437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1321194f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:00.341480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2d86,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4470}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:00.341867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:552 - treat_devices_removed completed in 0.115 Oct 23 01:06:00.342149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:552 - ports processed. Elapsed:0.130 Oct 23 01:06:00.342471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:552 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.130 Oct 23 01:06:02.213541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:553 started Oct 23 01:06:02.216232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=287000000,duration_sec=1123,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:02.217068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:02.217396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:553 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:02.242472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:02Z,description='Default security group',id=bb99366b-629c-4d26-bc72-0defc741432b,is_default=True,name='default',project_id='5e14aeb5b5554c1b906d12e0bef52827',revision_number=1,rules=[SecurityGroupRule(13034ee6-089e-479d-a613-27f20f9df5d2),SecurityGroupRule(6789978b-6c27-4150-8952-51c33ff37672),SecurityGroupRule(7c223fae-5a1c-497e-b4ef-8771b12ccebb),SecurityGroupRule(c9f9f482-2130-4b0e-a898-74fee4fbfd6a)],shared=False,stateful=True,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.242991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (bb99366b-629c-4d26-bc72-0defc741432b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.243752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='egress',ethertype='IPv4',id=13034ee6-089e-479d-a613-27f20f9df5d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e14aeb5b5554c1b906d12e0bef52827',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bb99366b-629c-4d26-bc72-0defc741432b,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.244173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (13034ee6-089e-479d-a613-27f20f9df5d2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.244504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.245191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='egress',ethertype='IPv6',id=6789978b-6c27-4150-8952-51c33ff37672,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e14aeb5b5554c1b906d12e0bef52827',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bb99366b-629c-4d26-bc72-0defc741432b,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.245538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (6789978b-6c27-4150-8952-51c33ff37672), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.245853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.246507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='ingress',ethertype='IPv6',id=7c223fae-5a1c-497e-b4ef-8771b12ccebb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e14aeb5b5554c1b906d12e0bef52827',protocol=,remote_address_group_id=,remote_group_id=bb99366b-629c-4d26-bc72-0defc741432b,remote_ip_prefix=,revision_number=0,security_group_id=bb99366b-629c-4d26-bc72-0defc741432b,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.246843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7c223fae-5a1c-497e-b4ef-8771b12ccebb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.247179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.247922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='ingress',ethertype='IPv4',id=c9f9f482-2130-4b0e-a898-74fee4fbfd6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5e14aeb5b5554c1b906d12e0bef52827',protocol=,remote_address_group_id=,remote_group_id=bb99366b-629c-4d26-bc72-0defc741432b,remote_ip_prefix=,revision_number=0,security_group_id=bb99366b-629c-4d26-bc72-0defc741432b,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.248261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c9f9f482-2130-4b0e-a898-74fee4fbfd6a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.248580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0fddffe8-782d-48c8-b801-8617cd70c864 admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.388430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Resource SecurityGroup deleted: bb99366b-629c-4d26-bc72-0defc741432b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.388892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (bb99366b-629c-4d26-bc72-0defc741432b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.389428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bb99366b-629c-4d26-bc72-0defc741432b',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:06:02.402581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bb99366b-629c-4d26-bc72-0defc741432b',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:06:02.402886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Resource SecurityGroupRule deleted: 13034ee6-089e-479d-a613-27f20f9df5d2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.403275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (13034ee6-089e-479d-a613-27f20f9df5d2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.403605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.403985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Resource SecurityGroupRule deleted: 6789978b-6c27-4150-8952-51c33ff37672 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.404541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (6789978b-6c27-4150-8952-51c33ff37672), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.404868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.405291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Resource SecurityGroupRule deleted: 7c223fae-5a1c-497e-b4ef-8771b12ccebb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.405622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7c223fae-5a1c-497e-b4ef-8771b12ccebb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.405901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.406264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Resource SecurityGroupRule deleted: c9f9f482-2130-4b0e-a898-74fee4fbfd6a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.406589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c9f9f482-2130-4b0e-a898-74fee4fbfd6a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.406894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b445290e-110b-4481-aa3f-043a18a82d0f admin admin] Security group rule updated ['bb99366b-629c-4d26-bc72-0defc741432b'] Oct 23 01:06:02.821907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:02Z,description='Default security group',id=b118c028-71e0-44e5-817c-57b8173f8857,is_default=True,name='default',project_id='90062c3a06f14bc09120c646e6264d98',revision_number=1,rules=[SecurityGroupRule(0df160a0-b42e-4426-8bb7-b4232df19438),SecurityGroupRule(791b8401-a396-4dec-8488-afe0f66d6df2),SecurityGroupRule(ac16c2f5-8e30-47ce-804f-2028ee87f3fe),SecurityGroupRule(b01a1eed-4a3f-442d-a291-428324326433)],shared=False,stateful=True,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.822288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b118c028-71e0-44e5-817c-57b8173f8857), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.822906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='ingress',ethertype='IPv6',id=0df160a0-b42e-4426-8bb7-b4232df19438,normalized_cidr=None,port_range_max=,port_range_min=,project_id='90062c3a06f14bc09120c646e6264d98',protocol=,remote_address_group_id=,remote_group_id=b118c028-71e0-44e5-817c-57b8173f8857,remote_ip_prefix=,revision_number=0,security_group_id=b118c028-71e0-44e5-817c-57b8173f8857,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.823556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0df160a0-b42e-4426-8bb7-b4232df19438), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.823927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:02.824590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='egress',ethertype='IPv6',id=791b8401-a396-4dec-8488-afe0f66d6df2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='90062c3a06f14bc09120c646e6264d98',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b118c028-71e0-44e5-817c-57b8173f8857,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.824973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (791b8401-a396-4dec-8488-afe0f66d6df2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.825304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:02.825948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='egress',ethertype='IPv4',id=ac16c2f5-8e30-47ce-804f-2028ee87f3fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='90062c3a06f14bc09120c646e6264d98',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b118c028-71e0-44e5-817c-57b8173f8857,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.826293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ac16c2f5-8e30-47ce-804f-2028ee87f3fe), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.826614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:02.827264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:02Z,description=,direction='ingress',ethertype='IPv4',id=b01a1eed-4a3f-442d-a291-428324326433,normalized_cidr=None,port_range_max=,port_range_min=,project_id='90062c3a06f14bc09120c646e6264d98',protocol=,remote_address_group_id=,remote_group_id=b118c028-71e0-44e5-817c-57b8173f8857,remote_ip_prefix=,revision_number=0,security_group_id=b118c028-71e0-44e5-817c-57b8173f8857,updated_at=2022-10-23T01:06:02Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:02.827609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b01a1eed-4a3f-442d-a291-428324326433), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.827982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-364426f0-b714-4639-9170-ec8c422c1790 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:02.952397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Resource SecurityGroup deleted: b118c028-71e0-44e5-817c-57b8173f8857 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.952805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b118c028-71e0-44e5-817c-57b8173f8857), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.953273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b118c028-71e0-44e5-817c-57b8173f8857',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:06:02.965991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b118c028-71e0-44e5-817c-57b8173f8857',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:06:02.966493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Resource SecurityGroupRule deleted: 0df160a0-b42e-4426-8bb7-b4232df19438 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.966917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0df160a0-b42e-4426-8bb7-b4232df19438), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.967287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:02.967913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Resource SecurityGroupRule deleted: 791b8401-a396-4dec-8488-afe0f66d6df2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.968433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (791b8401-a396-4dec-8488-afe0f66d6df2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.968834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:02.969256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Resource SecurityGroupRule deleted: ac16c2f5-8e30-47ce-804f-2028ee87f3fe {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.969595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ac16c2f5-8e30-47ce-804f-2028ee87f3fe), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.969904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:02.970263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Resource SecurityGroupRule deleted: b01a1eed-4a3f-442d-a291-428324326433 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:02.970594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b01a1eed-4a3f-442d-a291-428324326433), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:02.970898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44a5f205-b717-41ec-97b8-294ac64b6be4 admin admin] Security group rule updated ['b118c028-71e0-44e5-817c-57b8173f8857'] Oct 23 01:06:04.215022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:554 started Oct 23 01:06:04.217964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=289000000,duration_sec=1125,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:04.218622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:04.218983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:554 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:04.947772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:04Z,description='Default security group',id=e2934905-70ac-4000-8bf5-9afc2a15781e,is_default=True,name='default',project_id='36760fc0272a4bb39df3d6f6156d1e41',revision_number=1,rules=[SecurityGroupRule(96f33b96-6625-424b-8de0-436b2e9c9cf3),SecurityGroupRule(acc2358a-e1b5-4025-9fc7-3c61f49a61eb),SecurityGroupRule(d7b360a7-38a7-4512-b0f2-ebb0622f9b68),SecurityGroupRule(f13fbde4-7254-49e8-b4c8-ff5b9bfd3b47)],shared=False,stateful=True,updated_at=2022-10-23T01:06:04Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:04.948211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (e2934905-70ac-4000-8bf5-9afc2a15781e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:04.949092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:04Z,description=,direction='egress',ethertype='IPv6',id=96f33b96-6625-424b-8de0-436b2e9c9cf3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36760fc0272a4bb39df3d6f6156d1e41',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e2934905-70ac-4000-8bf5-9afc2a15781e,updated_at=2022-10-23T01:06:04Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:04.949512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (96f33b96-6625-424b-8de0-436b2e9c9cf3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:04.949973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:04.950967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:04Z,description=,direction='egress',ethertype='IPv4',id=acc2358a-e1b5-4025-9fc7-3c61f49a61eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36760fc0272a4bb39df3d6f6156d1e41',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e2934905-70ac-4000-8bf5-9afc2a15781e,updated_at=2022-10-23T01:06:04Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:04.951562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (acc2358a-e1b5-4025-9fc7-3c61f49a61eb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:04.952333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:04.953400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:04Z,description=,direction='ingress',ethertype='IPv6',id=d7b360a7-38a7-4512-b0f2-ebb0622f9b68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36760fc0272a4bb39df3d6f6156d1e41',protocol=,remote_address_group_id=,remote_group_id=e2934905-70ac-4000-8bf5-9afc2a15781e,remote_ip_prefix=,revision_number=0,security_group_id=e2934905-70ac-4000-8bf5-9afc2a15781e,updated_at=2022-10-23T01:06:04Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:04.953889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d7b360a7-38a7-4512-b0f2-ebb0622f9b68), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:04.954377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:04.955371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:04Z,description=,direction='ingress',ethertype='IPv4',id=f13fbde4-7254-49e8-b4c8-ff5b9bfd3b47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='36760fc0272a4bb39df3d6f6156d1e41',protocol=,remote_address_group_id=,remote_group_id=e2934905-70ac-4000-8bf5-9afc2a15781e,remote_ip_prefix=,revision_number=0,security_group_id=e2934905-70ac-4000-8bf5-9afc2a15781e,updated_at=2022-10-23T01:06:04Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:04.955876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f13fbde4-7254-49e8-b4c8-ff5b9bfd3b47), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:04.956351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-ea5e2b4c-f809-444d-9d86-82abbcd09f1c admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:05.085564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Resource SecurityGroup deleted: e2934905-70ac-4000-8bf5-9afc2a15781e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.085940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (e2934905-70ac-4000-8bf5-9afc2a15781e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.086397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e2934905-70ac-4000-8bf5-9afc2a15781e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:06:05.102522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e2934905-70ac-4000-8bf5-9afc2a15781e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:06:05.103059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Resource SecurityGroupRule deleted: 96f33b96-6625-424b-8de0-436b2e9c9cf3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.103448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (96f33b96-6625-424b-8de0-436b2e9c9cf3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.103768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:05.104157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Resource SecurityGroupRule deleted: acc2358a-e1b5-4025-9fc7-3c61f49a61eb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.104500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (acc2358a-e1b5-4025-9fc7-3c61f49a61eb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.104847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:05.105201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Resource SecurityGroupRule deleted: d7b360a7-38a7-4512-b0f2-ebb0622f9b68 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.105539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d7b360a7-38a7-4512-b0f2-ebb0622f9b68), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.105853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:05.106218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Resource SecurityGroupRule deleted: f13fbde4-7254-49e8-b4c8-ff5b9bfd3b47 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.106647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f13fbde4-7254-49e8-b4c8-ff5b9bfd3b47), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.106980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0020d258-66f8-4b16-aea5-196521925c9a admin admin] Security group rule updated ['e2934905-70ac-4000-8bf5-9afc2a15781e'] Oct 23 01:06:05.501238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:05Z,description='Default security group',id=426f1622-d85a-45e6-8a1b-b22856713260,is_default=True,name='default',project_id='75f293b752f3440ab5ba49b2c1bf97a2',revision_number=1,rules=[SecurityGroupRule(33bb3b38-545e-4011-b58c-c590c1e86dd3),SecurityGroupRule(52e13f94-1948-4a4d-8a97-205b850115c5),SecurityGroupRule(72031bcb-3576-4a8c-840e-36afac991752),SecurityGroupRule(7d3f5270-bfdb-4bfd-90f8-fea6e3f8c44b)],shared=False,stateful=True,updated_at=2022-10-23T01:06:05Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:05.501870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (426f1622-d85a-45e6-8a1b-b22856713260), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.502228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:05Z,description=,direction='egress',ethertype='IPv6',id=33bb3b38-545e-4011-b58c-c590c1e86dd3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75f293b752f3440ab5ba49b2c1bf97a2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=426f1622-d85a-45e6-8a1b-b22856713260,updated_at=2022-10-23T01:06:05Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:05.502776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (33bb3b38-545e-4011-b58c-c590c1e86dd3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.503136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:05.503812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:05Z,description=,direction='ingress',ethertype='IPv6',id=52e13f94-1948-4a4d-8a97-205b850115c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75f293b752f3440ab5ba49b2c1bf97a2',protocol=,remote_address_group_id=,remote_group_id=426f1622-d85a-45e6-8a1b-b22856713260,remote_ip_prefix=,revision_number=0,security_group_id=426f1622-d85a-45e6-8a1b-b22856713260,updated_at=2022-10-23T01:06:05Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:05.504160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (52e13f94-1948-4a4d-8a97-205b850115c5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.504487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:05.505177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:05Z,description=,direction='egress',ethertype='IPv4',id=72031bcb-3576-4a8c-840e-36afac991752,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75f293b752f3440ab5ba49b2c1bf97a2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=426f1622-d85a-45e6-8a1b-b22856713260,updated_at=2022-10-23T01:06:05Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:05.505526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (72031bcb-3576-4a8c-840e-36afac991752), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.505877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:05.506522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:05Z,description=,direction='ingress',ethertype='IPv4',id=7d3f5270-bfdb-4bfd-90f8-fea6e3f8c44b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75f293b752f3440ab5ba49b2c1bf97a2',protocol=,remote_address_group_id=,remote_group_id=426f1622-d85a-45e6-8a1b-b22856713260,remote_ip_prefix=,revision_number=0,security_group_id=426f1622-d85a-45e6-8a1b-b22856713260,updated_at=2022-10-23T01:06:05Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:05.506869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7d3f5270-bfdb-4bfd-90f8-fea6e3f8c44b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.507199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-cc0fa72a-6ff5-4d98-9117-5af1e5024a97 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:05.644986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Resource SecurityGroup deleted: 426f1622-d85a-45e6-8a1b-b22856713260 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.645386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (426f1622-d85a-45e6-8a1b-b22856713260), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.645855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('426f1622-d85a-45e6-8a1b-b22856713260',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:06:05.659465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('426f1622-d85a-45e6-8a1b-b22856713260',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:06:05.659870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Resource SecurityGroupRule deleted: 33bb3b38-545e-4011-b58c-c590c1e86dd3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.660238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (33bb3b38-545e-4011-b58c-c590c1e86dd3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.660587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:05.661127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Resource SecurityGroupRule deleted: 52e13f94-1948-4a4d-8a97-205b850115c5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.661387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (52e13f94-1948-4a4d-8a97-205b850115c5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.661708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:05.662314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Resource SecurityGroupRule deleted: 72031bcb-3576-4a8c-840e-36afac991752 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.662662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (72031bcb-3576-4a8c-840e-36afac991752), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.662979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:05.663382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Resource SecurityGroupRule deleted: 7d3f5270-bfdb-4bfd-90f8-fea6e3f8c44b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:05.663726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7d3f5270-bfdb-4bfd-90f8-fea6e3f8c44b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:05.664040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-358040d7-59ca-44c8-83ba-9876830d0363 admin admin] Security group rule updated ['426f1622-d85a-45e6-8a1b-b22856713260'] Oct 23 01:06:06.215801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:555 started Oct 23 01:06:06.218473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=289000000,duration_sec=1127,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:06.219059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:06.219410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:555 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:08.095816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:07Z,description='Default security group',id=eb480198-24aa-46c0-bbaa-c4eea1fbb7f7,is_default=True,name='default',project_id='4605f98e57f84d1d92009a4409cb425f',revision_number=1,rules=[SecurityGroupRule(7503b659-4d1a-4cbd-affe-e0223b001634),SecurityGroupRule(7ceb20d9-9711-4fc0-8fd4-944251a0716f),SecurityGroupRule(ae683bd5-be9c-49eb-bc16-da70dbd57682),SecurityGroupRule(b1bcab00-041b-4e1c-ad0b-8e5be181ae20)],shared=False,stateful=True,updated_at=2022-10-23T01:06:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.097139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (eb480198-24aa-46c0-bbaa-c4eea1fbb7f7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.101258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:08Z,description=,direction='ingress',ethertype='IPv6',id=7503b659-4d1a-4cbd-affe-e0223b001634,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4605f98e57f84d1d92009a4409cb425f',protocol=,remote_address_group_id=,remote_group_id=eb480198-24aa-46c0-bbaa-c4eea1fbb7f7,remote_ip_prefix=,revision_number=0,security_group_id=eb480198-24aa-46c0-bbaa-c4eea1fbb7f7,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.101711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7503b659-4d1a-4cbd-affe-e0223b001634), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.102111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.102840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:07Z,description=,direction='ingress',ethertype='IPv4',id=7ceb20d9-9711-4fc0-8fd4-944251a0716f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4605f98e57f84d1d92009a4409cb425f',protocol=,remote_address_group_id=,remote_group_id=eb480198-24aa-46c0-bbaa-c4eea1fbb7f7,remote_ip_prefix=,revision_number=0,security_group_id=eb480198-24aa-46c0-bbaa-c4eea1fbb7f7,updated_at=2022-10-23T01:06:07Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.103253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7ceb20d9-9711-4fc0-8fd4-944251a0716f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.103572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.104208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:08Z,description=,direction='egress',ethertype='IPv4',id=ae683bd5-be9c-49eb-bc16-da70dbd57682,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4605f98e57f84d1d92009a4409cb425f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eb480198-24aa-46c0-bbaa-c4eea1fbb7f7,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.104550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (ae683bd5-be9c-49eb-bc16-da70dbd57682), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.104897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.105531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:08Z,description=,direction='egress',ethertype='IPv6',id=b1bcab00-041b-4e1c-ad0b-8e5be181ae20,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4605f98e57f84d1d92009a4409cb425f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eb480198-24aa-46c0-bbaa-c4eea1fbb7f7,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.105871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b1bcab00-041b-4e1c-ad0b-8e5be181ae20), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.106186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-84c1d6eb-f4ce-4869-8b89-da0d3b4b8f8e admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.216624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:556 started Oct 23 01:06:08.220070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=290000000,duration_sec=1129,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:08.220284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:08.220800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:556 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:08.234143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Resource SecurityGroup deleted: eb480198-24aa-46c0-bbaa-c4eea1fbb7f7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.234512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (eb480198-24aa-46c0-bbaa-c4eea1fbb7f7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.234957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('eb480198-24aa-46c0-bbaa-c4eea1fbb7f7',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:06:08.249125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('eb480198-24aa-46c0-bbaa-c4eea1fbb7f7',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:06:08.249581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Resource SecurityGroupRule deleted: 7503b659-4d1a-4cbd-affe-e0223b001634 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.250000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7503b659-4d1a-4cbd-affe-e0223b001634), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.250420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.250822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Resource SecurityGroupRule deleted: 7ceb20d9-9711-4fc0-8fd4-944251a0716f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.251165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7ceb20d9-9711-4fc0-8fd4-944251a0716f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.251493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.252390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Resource SecurityGroupRule deleted: ae683bd5-be9c-49eb-bc16-da70dbd57682 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.252846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (ae683bd5-be9c-49eb-bc16-da70dbd57682), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.253195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.253737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Resource SecurityGroupRule deleted: b1bcab00-041b-4e1c-ad0b-8e5be181ae20 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.254073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b1bcab00-041b-4e1c-ad0b-8e5be181ae20), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.254397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-b5a47f67-0cd6-45e7-a4e8-dc6f61d8a780 admin admin] Security group rule updated ['eb480198-24aa-46c0-bbaa-c4eea1fbb7f7'] Oct 23 01:06:08.642820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:08Z,description='Default security group',id=2bc95f42-76b4-4f27-ac27-2e08db62a13d,is_default=True,name='default',project_id='725a1910004d4a0993407ed9c7add7d2',revision_number=1,rules=[SecurityGroupRule(60e9a48e-411a-4a10-ab59-5a6f13517869),SecurityGroupRule(7c99d483-7e87-4486-8b31-304ee744b6d6),SecurityGroupRule(a5be2b66-1010-427f-82fc-9bdbf5c4e764),SecurityGroupRule(f436df0e-1d68-402f-9c6a-dba67f4b0ca2)],shared=False,stateful=True,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.643227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (2bc95f42-76b4-4f27-ac27-2e08db62a13d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.643841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:08Z,description=,direction='ingress',ethertype='IPv4',id=60e9a48e-411a-4a10-ab59-5a6f13517869,normalized_cidr=None,port_range_max=,port_range_min=,project_id='725a1910004d4a0993407ed9c7add7d2',protocol=,remote_address_group_id=,remote_group_id=2bc95f42-76b4-4f27-ac27-2e08db62a13d,remote_ip_prefix=,revision_number=0,security_group_id=2bc95f42-76b4-4f27-ac27-2e08db62a13d,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.644170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (60e9a48e-411a-4a10-ab59-5a6f13517869), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.644933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:08.645573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:08Z,description=,direction='egress',ethertype='IPv4',id=7c99d483-7e87-4486-8b31-304ee744b6d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='725a1910004d4a0993407ed9c7add7d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2bc95f42-76b4-4f27-ac27-2e08db62a13d,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.646020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7c99d483-7e87-4486-8b31-304ee744b6d6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.646343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:08.646985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:08Z,description=,direction='egress',ethertype='IPv6',id=a5be2b66-1010-427f-82fc-9bdbf5c4e764,normalized_cidr=None,port_range_max=,port_range_min=,project_id='725a1910004d4a0993407ed9c7add7d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2bc95f42-76b4-4f27-ac27-2e08db62a13d,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.649012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a5be2b66-1010-427f-82fc-9bdbf5c4e764), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.649012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:08.649012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:08Z,description=,direction='ingress',ethertype='IPv6',id=f436df0e-1d68-402f-9c6a-dba67f4b0ca2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='725a1910004d4a0993407ed9c7add7d2',protocol=,remote_address_group_id=,remote_group_id=2bc95f42-76b4-4f27-ac27-2e08db62a13d,remote_ip_prefix=,revision_number=0,security_group_id=2bc95f42-76b4-4f27-ac27-2e08db62a13d,updated_at=2022-10-23T01:06:08Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:08.649012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (f436df0e-1d68-402f-9c6a-dba67f4b0ca2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.649358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-0d898ba7-d1ae-46fa-9464-c73a204519b8 admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:08.785206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Resource SecurityGroup deleted: 2bc95f42-76b4-4f27-ac27-2e08db62a13d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.785621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (2bc95f42-76b4-4f27-ac27-2e08db62a13d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.786068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2bc95f42-76b4-4f27-ac27-2e08db62a13d',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:06:08.801627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2bc95f42-76b4-4f27-ac27-2e08db62a13d',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:06:08.802048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Resource SecurityGroupRule deleted: 60e9a48e-411a-4a10-ab59-5a6f13517869 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.802423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (60e9a48e-411a-4a10-ab59-5a6f13517869), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.802755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:08.803113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Resource SecurityGroupRule deleted: 7c99d483-7e87-4486-8b31-304ee744b6d6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.803702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7c99d483-7e87-4486-8b31-304ee744b6d6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.804019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:08.804387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Resource SecurityGroupRule deleted: a5be2b66-1010-427f-82fc-9bdbf5c4e764 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.804739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a5be2b66-1010-427f-82fc-9bdbf5c4e764), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.805080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:08.805449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Resource SecurityGroupRule deleted: f436df0e-1d68-402f-9c6a-dba67f4b0ca2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:08.805812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (f436df0e-1d68-402f-9c6a-dba67f4b0ca2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:08.806138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-da36726f-5bd1-46a8-93ae-27862884cb6b admin admin] Security group rule updated ['2bc95f42-76b4-4f27-ac27-2e08db62a13d'] Oct 23 01:06:10.217472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:557 started Oct 23 01:06:10.221640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=291000000,duration_sec=1131,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:10.222484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:10.223021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:557 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:06:12.218667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:558 started Oct 23 01:06:12.221757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=292000000,duration_sec=1133,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:12.222327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:12.222685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:558 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:13.112483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:12Z,description='Default security group',id=761377d4-3f62-48f8-af29-3431916710e3,is_default=True,name='default',project_id='c06dba664a404e33a3d8712b9d362ebb',revision_number=1,rules=[SecurityGroupRule(1b93ebff-3742-461a-915d-d255bfe2e8b1),SecurityGroupRule(2c7b14f4-9e24-44d3-a302-a68b16481933),SecurityGroupRule(978d2154-d818-4172-a510-2b34305f8093),SecurityGroupRule(c26b89e8-4f7f-4033-b9c1-6ae79d93c28b)],shared=False,stateful=True,updated_at=2022-10-23T01:06:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:13.113068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (761377d4-3f62-48f8-af29-3431916710e3), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:13.113806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:12Z,description=,direction='egress',ethertype='IPv4',id=1b93ebff-3742-461a-915d-d255bfe2e8b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c06dba664a404e33a3d8712b9d362ebb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=761377d4-3f62-48f8-af29-3431916710e3,updated_at=2022-10-23T01:06:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:13.114406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (1b93ebff-3742-461a-915d-d255bfe2e8b1), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:13.114728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:13.115586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:12Z,description=,direction='ingress',ethertype='IPv6',id=2c7b14f4-9e24-44d3-a302-a68b16481933,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c06dba664a404e33a3d8712b9d362ebb',protocol=,remote_address_group_id=,remote_group_id=761377d4-3f62-48f8-af29-3431916710e3,remote_ip_prefix=,revision_number=0,security_group_id=761377d4-3f62-48f8-af29-3431916710e3,updated_at=2022-10-23T01:06:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:13.115932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (2c7b14f4-9e24-44d3-a302-a68b16481933), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:13.116317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:13.116989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:13Z,description=,direction='egress',ethertype='IPv6',id=978d2154-d818-4172-a510-2b34305f8093,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c06dba664a404e33a3d8712b9d362ebb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=761377d4-3f62-48f8-af29-3431916710e3,updated_at=2022-10-23T01:06:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:13.117334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (978d2154-d818-4172-a510-2b34305f8093), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:13.117648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:13.118475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:12Z,description=,direction='ingress',ethertype='IPv4',id=c26b89e8-4f7f-4033-b9c1-6ae79d93c28b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c06dba664a404e33a3d8712b9d362ebb',protocol=,remote_address_group_id=,remote_group_id=761377d4-3f62-48f8-af29-3431916710e3,remote_ip_prefix=,revision_number=0,security_group_id=761377d4-3f62-48f8-af29-3431916710e3,updated_at=2022-10-23T01:06:12Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:13.118816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (c26b89e8-4f7f-4033-b9c1-6ae79d93c28b), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:13.119126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:13.508615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:13Z,data_plane_status=None,description='',device_id='5da45b3c-109a-4cb0-842f-949410f9fbce',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a73013b0-c2ed-4f0a-a8fd-ca995321eed8,mac_address=fa:16:3e:ed:9a:61,name='',network_id=2d9b01b3-e97c-4df3-844d-94c9a4bcd3cd,numa_affinity_policy=,project_id='c06dba664a404e33a3d8712b9d362ebb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a73013b0-c2ed-4f0a-a8fd-ca995321eed8),security_group_ids=set([761377d4-3f62-48f8-af29-3431916710e3]),status='DOWN',updated_at=2022-10-23T01:06:13Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:13.509289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (a73013b0-c2ed-4f0a-a8fd-ca995321eed8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:13.509659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-7af78e96-a8c5-46df-99f7-0ca46695ffa0 tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Security group member updated {'761377d4-3f62-48f8-af29-3431916710e3'} Oct 23 01:06:14.211766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c3d5a30-baa5-4b45-9ec1-4eed833b8d7e service neutron] Resource Port a73013b0-c2ed-4f0a-a8fd-ca995321eed8 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=a73013b0-c2ed-4f0a-a8fd-ca995321eed8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a73013b0-c2ed-4f0a-a8fd-ca995321eed8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:14.212152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c3d5a30-baa5-4b45-9ec1-4eed833b8d7e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (a73013b0-c2ed-4f0a-a8fd-ca995321eed8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:14.219373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:559 started Oct 23 01:06:14.222694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=293000000,duration_sec=1135,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:14.223287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:14.223629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:559 - starting polling. Elapsed:0.004 Oct 23 01:06:14.224929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:14.226244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:559 - port information retrieved. Elapsed:0.007 Oct 23 01:06:14.226574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:559 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:06:14.529655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-0c3d5a30-baa5-4b45-9ec1-4eed833b8d7e service neutron] Resource Port a73013b0-c2ed-4f0a-a8fd-ca995321eed8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a73013b0-c2ed-4f0a-a8fd-ca995321eed8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a73013b0-c2ed-4f0a-a8fd-ca995321eed8,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a73013b0-c2ed-4f0a-a8fd-ca995321eed8,segment=NetworkSegment(1985ffcf-cc5f-4e68-9fb5-e5b651a8883a),segment_id=1985ffcf-cc5f-4e68-9fb5-e5b651a8883a)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:14.531008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-0c3d5a30-baa5-4b45-9ec1-4eed833b8d7e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (a73013b0-c2ed-4f0a-a8fd-ca995321eed8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:16.220128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:560 started Oct 23 01:06:16.222825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=294000000,duration_sec=1137,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:16.223411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:16.223747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:560 - starting polling. Elapsed:0.004 Oct 23 01:06:16.225035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:16.226327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:560 - port information retrieved. Elapsed:0.006 Oct 23 01:06:16.226658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:560 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:06:16.774668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port a73013b0-c2ed-4f0a-a8fd-ca995321eed8 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:16.774988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (a73013b0-c2ed-4f0a-a8fd-ca995321eed8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:18.221162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:561 started Oct 23 01:06:18.223838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=295000000,duration_sec=1139,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:18.224447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:18.224809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:561 - starting polling. Elapsed:0.004 Oct 23 01:06:18.226107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:18.227536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:561 - port information retrieved. Elapsed:0.007 Oct 23 01:06:18.227864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:561 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:06:18.796335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port a73013b0-c2ed-4f0a-a8fd-ca995321eed8 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:18.796808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (a73013b0-c2ed-4f0a-a8fd-ca995321eed8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:20.221813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:562 started Oct 23 01:06:20.224574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=295000000,duration_sec=1141,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:20.225709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:20.226389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:562 - starting polling. Elapsed:0.005 Oct 23 01:06:20.227873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:20.229205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:562 - port information retrieved. Elapsed:0.008 Oct 23 01:06:20.229535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:562 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:06:22.223095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:563 started Oct 23 01:06:22.225803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=297000000,duration_sec=1143,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:22.226395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:22.226754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:563 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:23.138690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-c7ef0aa2-f1d0-48a1-bd6a-e50d924d8bbc tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Resource Port deleted: a73013b0-c2ed-4f0a-a8fd-ca995321eed8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:23.139273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-c7ef0aa2-f1d0-48a1-bd6a-e50d924d8bbc tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (a73013b0-c2ed-4f0a-a8fd-ca995321eed8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:23.139914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-c7ef0aa2-f1d0-48a1-bd6a-e50d924d8bbc tempest-VolumesNegativeTest-669130902 tempest-VolumesNegativeTest-669130902-project] Security group member updated {'761377d4-3f62-48f8-af29-3431916710e3'} Oct 23 01:06:24.223902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:564 started Oct 23 01:06:24.226510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2d9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=297000000,duration_sec=1145,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:24.227100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:24.227438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:564 - starting polling. Elapsed:0.004 Oct 23 01:06:24.228700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:24.229538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port a73013b0-c2ed-4f0a-a8fd-ca995321eed8 not present in bridge br-int Oct 23 01:06:24.229871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:06:24.230142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['a73013b0-c2ed-4f0a-a8fd-ca995321eed8'] Oct 23 01:06:24.230483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port a73013b0-c2ed-4f0a-a8fd-ca995321eed8 is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:06:24.231741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:564 - port information retrieved. Elapsed:0.008 Oct 23 01:06:24.232087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:564 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:06:26.224447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:565 started Oct 23 01:06:26.227030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2da0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=298000000,duration_sec=1147,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:26.227657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:26.227964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:565 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:28.225039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:566 started Oct 23 01:06:28.227921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2da2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=298000000,duration_sec=1149,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:28.228511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:28.228908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:566 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:28.473499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Resource SecurityGroup deleted: 761377d4-3f62-48f8-af29-3431916710e3 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:28.474072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (761377d4-3f62-48f8-af29-3431916710e3), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:28.474724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('761377d4-3f62-48f8-af29-3431916710e3',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:06:28.488224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('761377d4-3f62-48f8-af29-3431916710e3',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:06:28.488626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Resource SecurityGroupRule deleted: 1b93ebff-3742-461a-915d-d255bfe2e8b1 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:28.489274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (1b93ebff-3742-461a-915d-d255bfe2e8b1), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:28.489998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:28.490259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Resource SecurityGroupRule deleted: 2c7b14f4-9e24-44d3-a302-a68b16481933 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:28.490816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (2c7b14f4-9e24-44d3-a302-a68b16481933), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:28.491517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:28.492129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Resource SecurityGroupRule deleted: 978d2154-d818-4172-a510-2b34305f8093 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:28.492408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (978d2154-d818-4172-a510-2b34305f8093), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:28.492741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:28.493139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Resource SecurityGroupRule deleted: c26b89e8-4f7f-4033-b9c1-6ae79d93c28b {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:06:28.493452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (c26b89e8-4f7f-4033-b9c1-6ae79d93c28b), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:28.493764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-2a50c0b3-7d5f-47c8-bdc9-64cb221a902e admin admin] Security group rule updated ['761377d4-3f62-48f8-af29-3431916710e3'] Oct 23 01:06:29.422506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:29Z,description='Default security group',id=be6f606d-5902-4115-b7e0-6435c12cf7b7,is_default=True,name='default',project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',revision_number=1,rules=[SecurityGroupRule(7aeca448-f99e-4dd6-b0ec-165533f7ca50),SecurityGroupRule(a794a9df-a24c-4748-8971-931b09ab6f17),SecurityGroupRule(d05dcd77-641f-40d5-afb7-684f06d69c7e),SecurityGroupRule(e70102d1-5694-423a-83c0-42f2abaeec15)],shared=False,stateful=True,updated_at=2022-10-23T01:06:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:29.423140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (be6f606d-5902-4115-b7e0-6435c12cf7b7), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:29.423673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:29Z,description=,direction='ingress',ethertype='IPv4',id=7aeca448-f99e-4dd6-b0ec-165533f7ca50,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol=,remote_address_group_id=,remote_group_id=be6f606d-5902-4115-b7e0-6435c12cf7b7,remote_ip_prefix=,revision_number=0,security_group_id=be6f606d-5902-4115-b7e0-6435c12cf7b7,updated_at=2022-10-23T01:06:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:29.424094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (7aeca448-f99e-4dd6-b0ec-165533f7ca50), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:29.424524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:06:29.425269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:29Z,description=,direction='ingress',ethertype='IPv6',id=a794a9df-a24c-4748-8971-931b09ab6f17,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol=,remote_address_group_id=,remote_group_id=be6f606d-5902-4115-b7e0-6435c12cf7b7,remote_ip_prefix=,revision_number=0,security_group_id=be6f606d-5902-4115-b7e0-6435c12cf7b7,updated_at=2022-10-23T01:06:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:29.425690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a794a9df-a24c-4748-8971-931b09ab6f17), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:29.426086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:06:29.426849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:29Z,description=,direction='egress',ethertype='IPv4',id=d05dcd77-641f-40d5-afb7-684f06d69c7e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=be6f606d-5902-4115-b7e0-6435c12cf7b7,updated_at=2022-10-23T01:06:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:29.427204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (d05dcd77-641f-40d5-afb7-684f06d69c7e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:29.427586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:06:29.428430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:29Z,description=,direction='egress',ethertype='IPv6',id=e70102d1-5694-423a-83c0-42f2abaeec15,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=be6f606d-5902-4115-b7e0-6435c12cf7b7,updated_at=2022-10-23T01:06:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:29.428806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (e70102d1-5694-423a-83c0-42f2abaeec15), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:29.429126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:06:29.584855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T01:06:29Z,description='',dns_domain=None,id=5a7a794d-63de-41f4-a83c-d34a596efe6e,mtu=1500,name='tempest-TestShelveInstance-653016299-network',project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5a7a794d-63de-41f4-a83c-d34a596efe6e),segments=[NetworkSegment(af830161-2f72-4b1d-b62f-9e0eb12ccd43)],shared=False,status='ACTIVE',updated_at=2022-10-23T01:06:29Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:29.585217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (5a7a794d-63de-41f4-a83c-d34a596efe6e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-fc231608-00c3-434a-8bb0-86e579b72513 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5a7a794d-63de-41f4-a83c-d34a596efe6e with segmentation id not found. Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 01:06:29.660833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 01:06:29.662242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 01:06:29.662242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 01:06:29.662242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 01:06:29.662242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5a7a794d-63de-41f4-a83c-d34a596efe6e with segmentation id not found. Oct 23 01:06:29.662242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 01:06:29.835156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6f7041cd-d185-46cb-a822-03319fb6eae5 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4ffb30dd-449a-4485-aa89-7bc7f938ef89)],cidr=172.20.0.0/28,created_at=2022-10-23T01:06:29Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=3d59b4dc-5424-4479-a128-51bbe59fdc02,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-653016299-subnet',network_id=5a7a794d-63de-41f4-a83c-d34a596efe6e,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T01:06:29Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:29.835519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6f7041cd-d185-46cb-a822-03319fb6eae5 admin admin] Publish callbacks [] for Subnet (3d59b4dc-5424-4479-a128-51bbe59fdc02), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:30.225908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:567 started Oct 23 01:06:30.229267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2da4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=300000000,duration_sec=1151,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:30.230096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:30.230463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:567 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:06:30.355884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d1ec0efa-0329-4dda-ac4c-048293eecf6e None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:30Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5a7a794d-63de-41f4-a83c-d34a596efe6e',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ed08c520-d224-4010-b30f-1caee6c4d7a8,mac_address=fa:16:3e:b7:d4:14,name='',network_id=5a7a794d-63de-41f4-a83c-d34a596efe6e,numa_affinity_policy=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ed08c520-d224-4010-b30f-1caee6c4d7a8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:06:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:30.356338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d1ec0efa-0329-4dda-ac4c-048293eecf6e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ed08c520-d224-4010-b30f-1caee6c4d7a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:30.602589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d1ec0efa-0329-4dda-ac4c-048293eecf6e None None] Resource Port ed08c520-d224-4010-b30f-1caee6c4d7a8 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ed08c520-d224-4010-b30f-1caee6c4d7a8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ed08c520-d224-4010-b30f-1caee6c4d7a8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ed08c520-d224-4010-b30f-1caee6c4d7a8,segment=NetworkSegment(af830161-2f72-4b1d-b62f-9e0eb12ccd43),segment_id=af830161-2f72-4b1d-b62f-9e0eb12ccd43)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:30.603722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d1ec0efa-0329-4dda-ac4c-048293eecf6e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ed08c520-d224-4010-b30f-1caee6c4d7a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:30.700166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["02839ce0-c86e-44ec-8ce3-cd51d293de37","insert","taped08c520-d2",["set",[]],["map",[["attached-mac","fa:16:3e:b7:d4:14"],["iface-id","ed08c520-d224-4010-b30f-1caee6c4d7a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:30.719792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e17572ec-3d8d-4515-92a6-b934559c359d admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:30Z,data_plane_status=None,description='',device_id='6a77e3bb-6c8e-4684-b904-39a621deba78',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=29e200d5-6454-43fe-8518-99a7bf660c1a,mac_address=fa:16:3e:ee:41:1a,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(29e200d5-6454-43fe-8518-99a7bf660c1a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:06:30Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:30.720886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e17572ec-3d8d-4515-92a6-b934559c359d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29e200d5-6454-43fe-8518-99a7bf660c1a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:30.723933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["02839ce0-c86e-44ec-8ce3-cd51d293de37","old",null,["set",[]],null],["","new","taped08c520-d2",33,["map",[["attached-mac","fa:16:3e:b7:d4:14"],["iface-id","ed08c520-d224-4010-b30f-1caee6c4d7a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:31.878348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-83c41610-00d8-4919-af57-b09c78e1ba4a None None] Resource Port ed08c520-d224-4010-b30f-1caee6c4d7a8 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:31.879483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-83c41610-00d8-4919-af57-b09c78e1ba4a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (ed08c520-d224-4010-b30f-1caee6c4d7a8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:32.226661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:568 started Oct 23 01:06:32.229215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2da6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=300000000,duration_sec=1153,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:32.229822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:32.230291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:568 - starting polling. Elapsed:0.004 Oct 23 01:06:32.231772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:32.233299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:568 - port information retrieved. Elapsed:0.007 Oct 23 01:06:32.233819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'8edb9f18-7960-4eae-89c3-6b941ce63ba3', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'ed08c520-d224-4010-b30f-1caee6c4d7a8', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': {'ed08c520-d224-4010-b30f-1caee6c4d7a8'}, 'removed': set(), 'updated': {'ed08c520-d224-4010-b30f-1caee6c4d7a8'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:32.234395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': 'ed08c520-d224-4010-b30f-1caee6c4d7a8', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5a7a794d-63de-41f4-a83c-d34a596efe6e', 'network_id': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'port_id': 'ed08c520-d224-4010-b30f-1caee6c4d7a8', 'mac_address': 'fa:16:3e:b7:d4:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d59b4dc-5424-4479-a128-51bbe59fdc02', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:32.235913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: ed08c520-d224-4010-b30f-1caee6c4d7a8 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:32.236265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port ed08c520-d224-4010-b30f-1caee6c4d7a8 updated. Details: {'device': 'ed08c520-d224-4010-b30f-1caee6c4d7a8', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5a7a794d-63de-41f4-a83c-d34a596efe6e', 'network_id': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'port_id': 'ed08c520-d224-4010-b30f-1caee6c4d7a8', 'mac_address': 'fa:16:3e:b7:d4:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d59b4dc-5424-4479-a128-51bbe59fdc02', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 01:06:32.236607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 13 as local vlan for net-id=5a7a794d-63de-41f4-a83c-d34a596efe6e, seg-id=369 Oct 23 01:06:32.239833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211951,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4465), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:32.242927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2da8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4109)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4465}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:32.243950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=taped08c520-d2, col_values=(('tag', 13),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:32.244603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=taped08c520-d2, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:32.245271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=taped08c520-d2, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:32.251262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=taped08c520-d2, col_values=(('other_config', {'net_uuid': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '369'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:32.258400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2daa,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:32.259040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:568 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.025 Oct 23 01:06:32.259595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 01:06:32.260097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'ed08c520-d224-4010-b30f-1caee6c4d7a8'} Oct 23 01:06:32.262413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:32.262919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:32.265550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:32.315927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10ff579-ed19-414f-8d5e-814cb518e76e]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:32.316567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:568 - agent port security group processed in 0.082 Oct 23 01:06:32.317457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for ed08c520-d224-4010-b30f-1caee6c4d7a8 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:32.474721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['ed08c520-d224-4010-b30f-1caee6c4d7a8'] and devices down [] completed. Oct 23 01:06:32.475229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:568 - ports processed. Elapsed:0.249 Oct 23 01:06:32.475565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:568 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.249 Oct 23 01:06:32.483543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8e0ebcc3-ff67-4404-b096-18fa2df0c216 None None] Resource Port 29e200d5-6454-43fe-8518-99a7bf660c1a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=29e200d5-6454-43fe-8518-99a7bf660c1a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=29e200d5-6454-43fe-8518-99a7bf660c1a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:32.484287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8e0ebcc3-ff67-4404-b096-18fa2df0c216 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29e200d5-6454-43fe-8518-99a7bf660c1a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:32.646452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a31f8d66-6c5e-451c-9426-c13e4497a365 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:32Z,data_plane_status=None,description='',device_id='6a77e3bb-6c8e-4684-b904-39a621deba78',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=52613b17-dcae-463f-82de-070ab81aef6a,mac_address=fa:16:3e:00:10:f6,name='',network_id=5a7a794d-63de-41f4-a83c-d34a596efe6e,numa_affinity_policy=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(52613b17-dcae-463f-82de-070ab81aef6a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:06:32Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:32.647010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a31f8d66-6c5e-451c-9426-c13e4497a365 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (52613b17-dcae-463f-82de-070ab81aef6a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:32.653010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8e0ebcc3-ff67-4404-b096-18fa2df0c216 None None] Resource Port 29e200d5-6454-43fe-8518-99a7bf660c1a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=29e200d5-6454-43fe-8518-99a7bf660c1a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=29e200d5-6454-43fe-8518-99a7bf660c1a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=29e200d5-6454-43fe-8518-99a7bf660c1a,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:32.653565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8e0ebcc3-ff67-4404-b096-18fa2df0c216 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29e200d5-6454-43fe-8518-99a7bf660c1a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:33.089002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a31f8d66-6c5e-451c-9426-c13e4497a365 admin admin] Received resource Port update without any changes: 52613b17-dcae-463f-82de-070ab81aef6a {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 01:06:33.175432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d062bdd2-b5e8-4f0c-950c-5a847b9fa717","insert","qg-29e200d5-64",["set",[]],["map",[["attached-mac","fa:16:3e:ee:41:1a"],["iface-id","29e200d5-6454-43fe-8518-99a7bf660c1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:33.219191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d062bdd2-b5e8-4f0c-950c-5a847b9fa717","old",null,["set",[]],null],["","new","qg-29e200d5-64",34,["map",[["attached-mac","fa:16:3e:ee:41:1a"],["iface-id","29e200d5-6454-43fe-8518-99a7bf660c1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:34.157428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:34Z,description='Default security group',id=b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e,is_default=True,name='default',project_id='ea6b722204ec4cf9a7e4656cced96e70',revision_number=1,rules=[SecurityGroupRule(0a39b9d5-6262-416d-bfe0-e68ad59ad0eb),SecurityGroupRule(0a3f29df-1284-40f8-ba43-d92892fe4726),SecurityGroupRule(155d3202-6496-465d-9ff2-fcfeb9313295),SecurityGroupRule(488e176b-6495-4c63-912c-73b899337e22)],shared=False,stateful=True,updated_at=2022-10-23T01:06:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:34.158059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.158438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:34Z,description=,direction='egress',ethertype='IPv4',id=0a39b9d5-6262-416d-bfe0-e68ad59ad0eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6b722204ec4cf9a7e4656cced96e70',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e,updated_at=2022-10-23T01:06:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:34.158791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0a39b9d5-6262-416d-bfe0-e68ad59ad0eb), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.159527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:06:34.160216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:34Z,description=,direction='ingress',ethertype='IPv6',id=0a3f29df-1284-40f8-ba43-d92892fe4726,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6b722204ec4cf9a7e4656cced96e70',protocol=,remote_address_group_id=,remote_group_id=b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e,remote_ip_prefix=,revision_number=0,security_group_id=b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e,updated_at=2022-10-23T01:06:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:34.160571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (0a3f29df-1284-40f8-ba43-d92892fe4726), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.160911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:06:34.162156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:34Z,description=,direction='egress',ethertype='IPv6',id=155d3202-6496-465d-9ff2-fcfeb9313295,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6b722204ec4cf9a7e4656cced96e70',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e,updated_at=2022-10-23T01:06:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:34.162506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (155d3202-6496-465d-9ff2-fcfeb9313295), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.162824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:06:34.163475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:34Z,description=,direction='ingress',ethertype='IPv4',id=488e176b-6495-4c63-912c-73b899337e22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea6b722204ec4cf9a7e4656cced96e70',protocol=,remote_address_group_id=,remote_group_id=b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e,remote_ip_prefix=,revision_number=0,security_group_id=b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e,updated_at=2022-10-23T01:06:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:34.163819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (488e176b-6495-4c63-912c-73b899337e22), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.164132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:06:34.227757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:569 started Oct 23 01:06:34.232352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=301000000,duration_sec=1155,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:34.233201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:34.233820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:569 - starting polling. Elapsed:0.006 Oct 23 01:06:34.235450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.237069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:569 - port information retrieved. Elapsed:0.009 Oct 23 01:06:34.237392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'ed08c520-d224-4010-b30f-1caee6c4d7a8', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '36027a75-3b26-4728-a464-23e4dbba5d4a', '29e200d5-6454-43fe-8518-99a7bf660c1a', '87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 'added': {'29e200d5-6454-43fe-8518-99a7bf660c1a'}, 'removed': set(), 'updated': {'29e200d5-6454-43fe-8518-99a7bf660c1a'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:34.237991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'mac_address': 'fa:16:3e:ee:41:1a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.85'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:34.239593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 29e200d5-6454-43fe-8518-99a7bf660c1a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:34.240088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 29e200d5-6454-43fe-8518-99a7bf660c1a updated. Details: {'device': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'mac_address': 'fa:16:3e:ee:41:1a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.85'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 01:06:34.241485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-29e200d5-64, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:34.241903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-29e200d5-64, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:34.242448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-29e200d5-64, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:34.248914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-29e200d5-64, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:34.258705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2dae,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:34.259573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:569 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 6 devices currently available. Time elapsed: 0.022 Oct 23 01:06:34.260295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 01:06:34.261628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'29e200d5-6454-43fe-8518-99a7bf660c1a'} Oct 23 01:06:34.266080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:34.266927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:34.272883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:34.313073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4566a2-16c4-40ef-ae3c-296b83ce0cf0]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:34.313682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:569 - agent port security group processed in 0.076 Oct 23 01:06:34.314470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 29e200d5-6454-43fe-8518-99a7bf660c1a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:34.332035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-23T01:06:34Z,description='',dns_domain=None,id=82a5267c-a1eb-4074-8b8c-eaaf871b7c4a,mtu=1500,name='tempest-TestShelveInstance-1827445567-network',project_id='ea6b722204ec4cf9a7e4656cced96e70',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(82a5267c-a1eb-4074-8b8c-eaaf871b7c4a),segments=[NetworkSegment(450fcc7b-a197-4f07-abc6-99822a34c9a4)],shared=False,status='ACTIVE',updated_at=2022-10-23T01:06:34Z,vlan_transparent=) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:34.332629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (82a5267c-a1eb-4074-8b8c-eaaf871b7c4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager [None req-f4459018-fb2c-4ca3-9dfb-ee9dc12e8559 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 82a5267c-a1eb-4074-8b8c-eaaf871b7c4a with segmentation id not found. Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 23 01:06:34.442762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 23 01:06:34.443927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 23 01:06:34.443927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 23 01:06:34.443927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 23 01:06:34.443927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 82a5267c-a1eb-4074-8b8c-eaaf871b7c4a with segmentation id not found. Oct 23 01:06:34.443927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: ERROR neutron_lib.callbacks.manager Oct 23 01:06:34.576530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['29e200d5-6454-43fe-8518-99a7bf660c1a'] and devices down [] completed. Oct 23 01:06:34.576871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:569 - ports processed. Elapsed:0.349 Oct 23 01:06:34.577381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:569 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.350 Oct 23 01:06:34.623701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3ecba73a-7802-4ade-bff7-a54c5ec04a42 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(0a7a9f01-4e52-4af0-a462-1aa9bf7ccf2b)],cidr=172.20.0.0/28,created_at=2022-10-23T01:06:34Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=5b676e81-ae04-4245-a21a-f4742a1bad4d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-1827445567-subnet',network_id=82a5267c-a1eb-4074-8b8c-eaaf871b7c4a,project_id='ea6b722204ec4cf9a7e4656cced96e70',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-23T01:06:34Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:34.624495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3ecba73a-7802-4ade-bff7-a54c5ec04a42 admin admin] Publish callbacks [] for Subnet (5b676e81-ae04-4245-a21a-f4742a1bad4d), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:34.661987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 29e200d5-6454-43fe-8518-99a7bf660c1a updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=29e200d5-6454-43fe-8518-99a7bf660c1a,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=29e200d5-6454-43fe-8518-99a7bf660c1a,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:34.662441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (29e200d5-6454-43fe-8518-99a7bf660c1a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:35.533907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-cc267ef4-4a16-4272-9191-be42725ea149 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:35Z,data_plane_status=None,description='',device_id='87d24b75-d0fd-43b3-92bd-43c4adbf28e4',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,mac_address=fa:16:3e:23:62:37,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(99db7be1-e4dc-4662-a5bb-e94fd92d7e45),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:06:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:35.534623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-cc267ef4-4a16-4272-9191-be42725ea149 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (99db7be1-e4dc-4662-a5bb-e94fd92d7e45), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:35.740956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a7f0ddae-779e-41c5-95f6-c9e36a452dc5 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:34Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-82a5267c-a1eb-4074-8b8c-eaaf871b7c4a',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9ec59cc1-5f76-46ca-bc46-9da595ea58e5,mac_address=fa:16:3e:53:0d:1b,name='',network_id=82a5267c-a1eb-4074-8b8c-eaaf871b7c4a,numa_affinity_policy=,project_id='ea6b722204ec4cf9a7e4656cced96e70',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9ec59cc1-5f76-46ca-bc46-9da595ea58e5),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:06:35Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:35.741627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a7f0ddae-779e-41c5-95f6-c9e36a452dc5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (9ec59cc1-5f76-46ca-bc46-9da595ea58e5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:36.004151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-adbdca5a-e4d8-48ad-b33d-1a4779f736b8 None None] Resource Port 52613b17-dcae-463f-82de-070ab81aef6a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=52613b17-dcae-463f-82de-070ab81aef6a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52613b17-dcae-463f-82de-070ab81aef6a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:36.005266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-adbdca5a-e4d8-48ad-b33d-1a4779f736b8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (52613b17-dcae-463f-82de-070ab81aef6a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:36.220801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-a7f0ddae-779e-41c5-95f6-c9e36a452dc5 None None] Resource Port 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9ec59cc1-5f76-46ca-bc46-9da595ea58e5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9ec59cc1-5f76-46ca-bc46-9da595ea58e5,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9ec59cc1-5f76-46ca-bc46-9da595ea58e5,segment=NetworkSegment(450fcc7b-a197-4f07-abc6-99822a34c9a4),segment_id=450fcc7b-a197-4f07-abc6-99822a34c9a4)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:36.221560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-a7f0ddae-779e-41c5-95f6-c9e36a452dc5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (9ec59cc1-5f76-46ca-bc46-9da595ea58e5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:36.229208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:570 started Oct 23 01:06:36.233415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2db0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=304000000,duration_sec=1157,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:36.234501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:36.235120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:570 - starting polling. Elapsed:0.006 Oct 23 01:06:36.240083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:36.241708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:570 - port information retrieved. Elapsed:0.013 Oct 23 01:06:36.242036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'ed08c520-d224-4010-b30f-1caee6c4d7a8', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '36027a75-3b26-4728-a464-23e4dbba5d4a', '29e200d5-6454-43fe-8518-99a7bf660c1a', '87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 'added': set(), 'removed': set(), 'updated': {'29e200d5-6454-43fe-8518-99a7bf660c1a'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:36.242638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'mac_address': 'fa:16:3e:ee:41:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.85'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:36.244158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 29e200d5-6454-43fe-8518-99a7bf660c1a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:36.244658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 29e200d5-6454-43fe-8518-99a7bf660c1a updated. Details: {'device': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '29e200d5-6454-43fe-8518-99a7bf660c1a', 'mac_address': 'fa:16:3e:ee:41:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.85'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 01:06:36.245933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-29e200d5-64, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:36.247866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-29e200d5-64, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:36.248854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-29e200d5-64, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:36.250220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:36.252471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-29e200d5-64, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:36.253432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:36.256921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2db2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:36.257580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:570 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 6 devices currently available. Time elapsed: 0.015 Oct 23 01:06:36.258118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 01:06:36.258586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 01:06:36.260160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:36.261455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:36.267625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:36.333358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["efd939bd-cb44-4623-a74d-b9976d3dd2ed","insert","tap9ec59cc1-5f",["set",[]],["map",[["attached-mac","fa:16:3e:53:0d:1b"],["iface-id","9ec59cc1-5f76-46ca-bc46-9da595ea58e5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:36.334555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac384cea-9eed-4f90-aeea-16be6cd0978b]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:36.335383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:570 - agent port security group processed in 0.093 Oct 23 01:06:36.336084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 29e200d5-6454-43fe-8518-99a7bf660c1a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:36.371613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["efd939bd-cb44-4623-a74d-b9976d3dd2ed","old",null,["set",[]],null],["","new","tap9ec59cc1-5f",35,["map",[["attached-mac","fa:16:3e:53:0d:1b"],["iface-id","9ec59cc1-5f76-46ca-bc46-9da595ea58e5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:36.518787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-adbdca5a-e4d8-48ad-b33d-1a4779f736b8 None None] Resource Port 52613b17-dcae-463f-82de-070ab81aef6a updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52613b17-dcae-463f-82de-070ab81aef6a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52613b17-dcae-463f-82de-070ab81aef6a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=52613b17-dcae-463f-82de-070ab81aef6a,segment=NetworkSegment(af830161-2f72-4b1d-b62f-9e0eb12ccd43),segment_id=af830161-2f72-4b1d-b62f-9e0eb12ccd43)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:36.519146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-adbdca5a-e4d8-48ad-b33d-1a4779f736b8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (52613b17-dcae-463f-82de-070ab81aef6a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:36.785823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['29e200d5-6454-43fe-8518-99a7bf660c1a'] and devices down [] completed. Oct 23 01:06:36.787215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:570 - ports processed. Elapsed:0.558 Oct 23 01:06:36.787712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:570 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.559 Oct 23 01:06:36.909182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9ce14450-ca35-4d93-a902-8223534b0da7","insert","qr-52613b17-dc",["set",[]],["map",[["attached-mac","fa:16:3e:00:10:f6"],["iface-id","52613b17-dcae-463f-82de-070ab81aef6a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:36.941979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9ce14450-ca35-4d93-a902-8223534b0da7","old",null,["set",[]],null],["","new","qr-52613b17-dc",36,["map",[["attached-mac","fa:16:3e:00:10:f6"],["iface-id","52613b17-dcae-463f-82de-070ab81aef6a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:37.120811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb0e8be9-c256-436a-a079-5e146a5fc9ff None None] Resource Port 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:37.120811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb0e8be9-c256-436a-a079-5e146a5fc9ff None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (99db7be1-e4dc-4662-a5bb-e94fd92d7e45), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:37.512208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72d23f25-d34e-472b-a636-9197106b1eaf admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:37Z,data_plane_status=None,description='',device_id='87d24b75-d0fd-43b3-92bd-43c4adbf28e4',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=06df1483-bd9e-4eb6-88e8-3ef5747f9fd5,mac_address=fa:16:3e:bd:d1:aa,name='',network_id=82a5267c-a1eb-4074-8b8c-eaaf871b7c4a,numa_affinity_policy=,project_id='ea6b722204ec4cf9a7e4656cced96e70',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(06df1483-bd9e-4eb6-88e8-3ef5747f9fd5),security_group_ids=set([]),status='DOWN',updated_at=2022-10-23T01:06:37Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:37.512586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-72d23f25-d34e-472b-a636-9197106b1eaf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (06df1483-bd9e-4eb6-88e8-3ef5747f9fd5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:37.539559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-bb0e8be9-c256-436a-a079-5e146a5fc9ff None None] Resource Port 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:37.539946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-bb0e8be9-c256-436a-a079-5e146a5fc9ff None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (99db7be1-e4dc-4662-a5bb-e94fd92d7e45), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:37.750143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d7af201d-5aa0-42f3-adaf-f6bf66bc976d None None] Resource Port 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:37.750822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d7af201d-5aa0-42f3-adaf-f6bf66bc976d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (9ec59cc1-5f76-46ca-bc46-9da595ea58e5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:38.072521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72d23f25-d34e-472b-a636-9197106b1eaf admin admin] Received resource Port update without any changes: 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 23 01:06:38.229738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:571 started Oct 23 01:06:38.232410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2db4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=303000000,duration_sec=1159,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:38.234239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5fca1397-c53f-4bf2-b2c6-2baa40f3f2b4","insert","qg-99db7be1-e4",["set",[]],["map",[["attached-mac","fa:16:3e:23:62:37"],["iface-id","99db7be1-e4dc-4662-a5bb-e94fd92d7e45"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:38.245176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:38.245176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:571 - starting polling. Elapsed:0.013 Oct 23 01:06:38.245176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 not ready yet on the bridge {{(pid=105573) _process_port /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1770}} Oct 23 01:06:38.245176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:38.267845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:571 - port information retrieved. Elapsed:0.038 Oct 23 01:06:38.268495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'ed08c520-d224-4010-b30f-1caee6c4d7a8', '0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '52613b17-dcae-463f-82de-070ab81aef6a', '36027a75-3b26-4728-a464-23e4dbba5d4a', '29e200d5-6454-43fe-8518-99a7bf660c1a', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', '87cfa4c1-a876-469a-b6ca-e739a6b2f813'}, 'added': {'52613b17-dcae-463f-82de-070ab81aef6a', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5'}, 'removed': set(), 'updated': {'9ec59cc1-5f76-46ca-bc46-9da595ea58e5', '52613b17-dcae-463f-82de-070ab81aef6a'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:38.269378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '52613b17-dcae-463f-82de-070ab81aef6a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'port_id': '52613b17-dcae-463f-82de-070ab81aef6a', 'mac_address': 'fa:16:3e:00:10:f6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d59b4dc-5424-4479-a128-51bbe59fdc02', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:38.270346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'network_id': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'port_id': '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', 'mac_address': 'fa:16:3e:53:0d:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5b676e81-ae04-4245-a21a-f4742a1bad4d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:38.275019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 52613b17-dcae-463f-82de-070ab81aef6a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:38.275359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 52613b17-dcae-463f-82de-070ab81aef6a updated. Details: {'device': '52613b17-dcae-463f-82de-070ab81aef6a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'port_id': '52613b17-dcae-463f-82de-070ab81aef6a', 'mac_address': 'fa:16:3e:00:10:f6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d59b4dc-5424-4479-a128-51bbe59fdc02', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 23 01:06:38.276609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5fca1397-c53f-4bf2-b2c6-2baa40f3f2b4","old",null,["set",[]],null],["","new","qg-99db7be1-e4",37,["map",[["attached-mac","fa:16:3e:23:62:37"],["iface-id","99db7be1-e4dc-4662-a5bb-e94fd92d7e45"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:38.279486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-52613b17-dc, col_values=(('tag', 13),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.280109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-52613b17-dc, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.280711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-52613b17-dc, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.307158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-52613b17-dc, col_values=(('other_config', {'net_uuid': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '369'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.315306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2db6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:38.315652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:38.315995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 updated. Details: {'device': '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'network_id': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'port_id': '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', 'mac_address': 'fa:16:3e:53:0d:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5b676e81-ae04-4245-a21a-f4742a1bad4d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 23 01:06:38.316328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Assigning 14 as local vlan for net-id=82a5267c-a1eb-4074-8b8c-eaaf871b7c4a, seg-id=389 Oct 23 01:06:38.323102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x13211953,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17615684023133517336,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4485), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:38.330461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x5fee2db8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4110)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4485}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:38.331772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9ec59cc1-5f, col_values=(('tag', 14),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.332349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap9ec59cc1-5f, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.333258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap9ec59cc1-5f, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.345240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9ec59cc1-5f, col_values=(('other_config', {'net_uuid': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '389'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:38.365553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2dba,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:38.365902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:571 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.097 Oct 23 01:06:38.366439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 2 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 01:06:38.366897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'52613b17-dcae-463f-82de-070ab81aef6a', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5'} Oct 23 01:06:38.370072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:38.370354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:38.377457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:38.440534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9a132-08c3-4684-91a2-5f3cedcd7dd8]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:38.441413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:571 - agent port security group processed in 0.172 Oct 23 01:06:38.442561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 52613b17-dcae-463f-82de-070ab81aef6a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:38.443566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:38.784370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 52613b17-dcae-463f-82de-070ab81aef6a updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:38.784888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (52613b17-dcae-463f-82de-070ab81aef6a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:38.867845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['52613b17-dcae-463f-82de-070ab81aef6a', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5'] and devices down [] completed. Oct 23 01:06:38.868255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:571 - ports processed. Elapsed:0.639 Oct 23 01:06:38.868703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:571 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:0.639 Oct 23 01:06:39.123529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-23T01:06:39Z,description='tempest-secgroup-smoke-1932338311 description',id=ab9eb3ca-df12-4428-a139-c340f28f0576,is_default=False,name='tempest-secgroup-smoke-1932338311',project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',revision_number=1,rules=[SecurityGroupRule(5318c5e2-caa7-4c33-bcad-467b14f97075),SecurityGroupRule(fdb1d684-4c6f-4de4-83ce-05ec4d68cdd2)],shared=False,stateful=True,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.124249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-868330'] for SecurityGroup (ab9eb3ca-df12-4428-a139-c340f28f0576), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.124740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description=,direction='egress',ethertype='IPv6',id=5318c5e2-caa7-4c33-bcad-467b14f97075,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.125541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (5318c5e2-caa7-4c33-bcad-467b14f97075), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.126167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:39.127310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description=,direction='egress',ethertype='IPv4',id=fdb1d684-4c6f-4de4-83ce-05ec4d68cdd2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.127932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (fdb1d684-4c6f-4de4-83ce-05ec4d68cdd2), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.128541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-11c681a0-7f8d-408d-8733-52f427b22afd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:39.231157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-8d3402fb-bb21-4691-9f8e-c96f7b1f030c tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description='',direction='ingress',ethertype='IPv4',id=9a63daf0-7259-4bce-ada9-a68282e4569e,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.231523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-8d3402fb-bb21-4691-9f8e-c96f7b1f030c tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9a63daf0-7259-4bce-ada9-a68282e4569e), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.231907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-8d3402fb-bb21-4691-9f8e-c96f7b1f030c tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:39.383676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-86e85f13-d80e-42a7-9ebd-fa92fd3744b1 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description='',direction='egress',ethertype='IPv4',id=759f0de0-9c7d-4f56-8a28-513b22b936a6,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.384037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-86e85f13-d80e-42a7-9ebd-fa92fd3744b1 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (759f0de0-9c7d-4f56-8a28-513b22b936a6), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.384376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-86e85f13-d80e-42a7-9ebd-fa92fd3744b1 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:39.517980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-36ff7266-6992-4887-9960-7ebb9ee081cd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description='',direction='ingress',ethertype='IPv4',id=9d30928f-62c1-4ca8-80db-07a43cc42302,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.518360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-36ff7266-6992-4887-9960-7ebb9ee081cd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (9d30928f-62c1-4ca8-80db-07a43cc42302), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.518733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-36ff7266-6992-4887-9960-7ebb9ee081cd tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:39.666214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-33aadfe8-cf11-44c9-bdc7-a3ec52156175 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description='',direction='egress',ethertype='IPv4',id=b8b62cdb-f3e9-4899-9060-b8fc90f5bff8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.666589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-33aadfe8-cf11-44c9-bdc7-a3ec52156175 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (b8b62cdb-f3e9-4899-9060-b8fc90f5bff8), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.666925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-33aadfe8-cf11-44c9-bdc7-a3ec52156175 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:39.822579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-e0131536-6f45-460b-b8fa-bc135f4445d0 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description='',direction='ingress',ethertype='IPv6',id=a2d47f81-87a1-4137-b1f5-dda1dae6cf4a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.823099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-e0131536-6f45-460b-b8fa-bc135f4445d0 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a2d47f81-87a1-4137-b1f5-dda1dae6cf4a), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.823535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-e0131536-6f45-460b-b8fa-bc135f4445d0 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:39.968270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-d7a3d07e-4969-483d-96d2-441593597888 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-23T01:06:39Z,description='',direction='egress',ethertype='IPv6',id=a563f972-a8fd-42d0-a38f-97a5e0af4c42,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9eb3ca-df12-4428-a139-c340f28f0576,updated_at=2022-10-23T01:06:39Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:39.968682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-d7a3d07e-4969-483d-96d2-441593597888 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-868343'] for SecurityGroupRule (a563f972-a8fd-42d0-a38f-97a5e0af4c42), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:39.969053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-d7a3d07e-4969-483d-96d2-441593597888 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:06:40.230620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:572 started Oct 23 01:06:40.233266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=304000000,duration_sec=1161,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:40.233864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:40.234294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:572 - starting polling. Elapsed:0.004 Oct 23 01:06:40.235125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'qg-99db7be1-e4'} are now ready {{(pid=105573) process_ports_events /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1785}} Oct 23 01:06:40.235449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports set() were not ready at last iteration and are not ready yet {{(pid=105573) process_ports_events /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1789}} Oct 23 01:06:40.237065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:40.239084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:572 - port information retrieved. Elapsed:0.009 Oct 23 01:06:40.239409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '29e200d5-6454-43fe-8518-99a7bf660c1a', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'ed08c520-d224-4010-b30f-1caee6c4d7a8', '52613b17-dcae-463f-82de-070ab81aef6a', '36027a75-3b26-4728-a464-23e4dbba5d4a', '99db7be1-e4dc-4662-a5bb-e94fd92d7e45'}, 'added': {'99db7be1-e4dc-4662-a5bb-e94fd92d7e45'}, 'removed': set(), 'updated': {'52613b17-dcae-463f-82de-070ab81aef6a'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:40.240626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'mac_address': 'fa:16:3e:23:62:37', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.251'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:40.241311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '52613b17-dcae-463f-82de-070ab81aef6a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'port_id': '52613b17-dcae-463f-82de-070ab81aef6a', 'mac_address': 'fa:16:3e:00:10:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d59b4dc-5424-4479-a128-51bbe59fdc02', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:40.243579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:40.243910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 updated. Details: {'device': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'mac_address': 'fa:16:3e:23:62:37', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.251'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 01:06:40.244935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-99db7be1-e4, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.245363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-99db7be1-e4, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.245798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-99db7be1-e4, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.252193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-99db7be1-e4, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.265120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2dbe,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:40.265428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 52613b17-dcae-463f-82de-070ab81aef6a {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:40.265973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 52613b17-dcae-463f-82de-070ab81aef6a updated. Details: {'device': '52613b17-dcae-463f-82de-070ab81aef6a', 'device_id': '6a77e3bb-6c8e-4684-b904-39a621deba78', 'network_id': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'port_id': '52613b17-dcae-463f-82de-070ab81aef6a', 'mac_address': 'fa:16:3e:00:10:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3d59b4dc-5424-4479-a128-51bbe59fdc02', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 23 01:06:40.266909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-52613b17-dc, col_values=(('tag', 13),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.267556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-52613b17-dc, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.267957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-52613b17-dc, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.268399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:40.269185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-52613b17-dc, col_values=(('other_config', {'net_uuid': '5a7a794d-63de-41f4-a83c-d34a596efe6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '369', 'tag': '13'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:40.269883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:40.272640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2dc0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:40.273009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:572 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.033 Oct 23 01:06:40.273529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 01:06:40.273992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'99db7be1-e4dc-4662-a5bb-e94fd92d7e45'} Oct 23 01:06:40.275228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:40.275512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:40.278410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:40.316318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e961430-50bc-4dfd-b9ff-60f854cdc1dd]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:40.317018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 01:06:40.317329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 01:06:40.318905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:40.319187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:40.322102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:40.378195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb85033b-39ce-4abc-a45f-e57094937616]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:40.379424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:572 - agent port security group processed in 0.140 Oct 23 01:06:40.380147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:40.380589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 52613b17-dcae-463f-82de-070ab81aef6a to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:41.082638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=99db7be1-e4dc-4662-a5bb-e94fd92d7e45,segment=NetworkSegment(0d47d9bc-e081-4c9e-9d69-e5804f7aef1d),segment_id=0d47d9bc-e081-4c9e-9d69-e5804f7aef1d)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:41.083451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (99db7be1-e4dc-4662-a5bb-e94fd92d7e45), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:41.266938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['99db7be1-e4dc-4662-a5bb-e94fd92d7e45', '52613b17-dcae-463f-82de-070ab81aef6a'] and devices down [] completed. Oct 23 01:06:41.267587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:572 - ports processed. Elapsed:1.037 Oct 23 01:06:41.267587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:572 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.037 Oct 23 01:06:41.498186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5f77a508-174b-45fe-be98-54665fbdfeaf None None] Resource Port 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=06df1483-bd9e-4eb6-88e8-3ef5747f9fd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=06df1483-bd9e-4eb6-88e8-3ef5747f9fd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:41.498642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5f77a508-174b-45fe-be98-54665fbdfeaf None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (06df1483-bd9e-4eb6-88e8-3ef5747f9fd5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:41.766313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5f77a508-174b-45fe-be98-54665fbdfeaf None None] Resource Port 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=06df1483-bd9e-4eb6-88e8-3ef5747f9fd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=06df1483-bd9e-4eb6-88e8-3ef5747f9fd5,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=06df1483-bd9e-4eb6-88e8-3ef5747f9fd5,segment=NetworkSegment(450fcc7b-a197-4f07-abc6-99822a34c9a4),segment_id=450fcc7b-a197-4f07-abc6-99822a34c9a4)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:41.766797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5f77a508-174b-45fe-be98-54665fbdfeaf None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (06df1483-bd9e-4eb6-88e8-3ef5747f9fd5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:42.101123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["204a5f9b-8d50-4315-83c3-498d13be345a","insert","qr-06df1483-bd",["set",[]],["map",[["attached-mac","fa:16:3e:bd:d1:aa"],["iface-id","06df1483-bd9e-4eb6-88e8-3ef5747f9fd5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:42.116506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["204a5f9b-8d50-4315-83c3-498d13be345a","old",null,["set",[]],null],["","new","qr-06df1483-bd",38,["map",[["attached-mac","fa:16:3e:bd:d1:aa"],["iface-id","06df1483-bd9e-4eb6-88e8-3ef5747f9fd5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:06:42.231991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:573 started Oct 23 01:06:42.235005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=305000000,duration_sec=1163,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:42.235689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:42.236263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:573 - starting polling. Elapsed:0.004 Oct 23 01:06:42.238230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:42.240693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:573 - port information retrieved. Elapsed:0.009 Oct 23 01:06:42.241143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', '29e200d5-6454-43fe-8518-99a7bf660c1a', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'ed08c520-d224-4010-b30f-1caee6c4d7a8', '52613b17-dcae-463f-82de-070ab81aef6a', '36027a75-3b26-4728-a464-23e4dbba5d4a', '99db7be1-e4dc-4662-a5bb-e94fd92d7e45'}, 'added': {'06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'}, 'removed': set(), 'updated': {'99db7be1-e4dc-4662-a5bb-e94fd92d7e45', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:42.241747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'mac_address': 'fa:16:3e:23:62:37', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.251'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:42.242212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'port_id': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'mac_address': 'fa:16:3e:bd:d1:aa', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5b676e81-ae04-4245-a21a-f4742a1bad4d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:42.244365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:42.244693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 updated. Details: {'device': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'port_id': '99db7be1-e4dc-4662-a5bb-e94fd92d7e45', 'mac_address': 'fa:16:3e:23:62:37', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'dd152ba8-6213-403c-b7fc-9b4ab174f9a2', 'ip_address': '172.37.4.251'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 23 01:06:42.245796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-99db7be1-e4, col_values=(('tag', 2),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.246255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-99db7be1-e4, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.246656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-99db7be1-e4, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.247098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:42.247858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-99db7be1-e4, col_values=(('other_config', {'net_uuid': 'f9ff398c-cd2a-4430-b908-7f7163c266f3', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.248494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:42.250951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2dc4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:42.251512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:42.251887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 updated. Details: {'device': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'port_id': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'mac_address': 'fa:16:3e:bd:d1:aa', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5b676e81-ae04-4245-a21a-f4742a1bad4d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 23 01:06:42.252857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-06df1483-bd, col_values=(('tag', 14),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.253265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-06df1483-bd, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.253697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-06df1483-bd, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.259799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-06df1483-bd, col_values=(('other_config', {'net_uuid': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '389'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:42.269376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2dc6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:42.270112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:573 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.028 Oct 23 01:06:42.270234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing device filters for 1 new devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 23 01:06:42.270619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Preparing filters for devices {'06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'} Oct 23 01:06:42.271862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:42.272139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:42.275273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:42.313084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d898f30-c7cb-4bdb-baa3-7789b0d039df]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:42.313717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 01:06:42.314016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 01:06:42.315213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:42.315592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:42.318871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:42.358051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba51ee0-eb45-44b8-85c6-3d2773382db6]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:42.358627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:573 - agent port security group processed in 0.117 Oct 23 01:06:42.359405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:42.359831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:42.678695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['99db7be1-e4dc-4662-a5bb-e94fd92d7e45', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'] and devices down [] completed. Oct 23 01:06:42.679603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:573 - ports processed. Elapsed:0.448 Oct 23 01:06:42.680027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:573 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.448 Oct 23 01:06:42.744524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Resource Port 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:42.745179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-284dbfdd-d3c5-4b06-9aa6-7c92455af400 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (06df1483-bd9e-4eb6-88e8-3ef5747f9fd5), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:44.233895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:574 started Oct 23 01:06:44.237745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=308000000,duration_sec=1165,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:44.238445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:44.238951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:574 - starting polling. Elapsed:0.005 Oct 23 01:06:44.242697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:44.247563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:574 - port information retrieved. Elapsed:0.014 Oct 23 01:06:44.248391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', '29e200d5-6454-43fe-8518-99a7bf660c1a', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', 'ed08c520-d224-4010-b30f-1caee6c4d7a8', '52613b17-dcae-463f-82de-070ab81aef6a', '36027a75-3b26-4728-a464-23e4dbba5d4a', '99db7be1-e4dc-4662-a5bb-e94fd92d7e45'}, 'added': set(), 'removed': set(), 'updated': {'06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'}, 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:06:44.249779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Returning: {'device': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'port_id': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'mac_address': 'fa:16:3e:bd:d1:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5b676e81-ae04-4245-a21a-f4742a1bad4d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105573) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 23 01:06:44.253996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing port: 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 {{(pid=105573) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 23 01:06:44.254409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 updated. Details: {'device': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'device_id': '87d24b75-d0fd-43b3-92bd-43c4adbf28e4', 'network_id': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'port_id': '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', 'mac_address': 'fa:16:3e:bd:d1:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5b676e81-ae04-4245-a21a-f4742a1bad4d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 23 01:06:44.255679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-06df1483-bd, col_values=(('tag', 14),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:44.256309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-06df1483-bd, column=vlan_mode) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:44.256944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-06df1483-bd, column=trunks) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:44.257523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:44.258409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-06df1483-bd, col_values=(('other_config', {'net_uuid': '82a5267c-a1eb-4074-8b8c-eaaf871b7c4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '389', 'tag': '14'}),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:06:44.259224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 23 01:06:44.262283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2dca,OFPFlowMod(buffer_id=4294967295,command=4,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:44.262830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:574 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.014 Oct 23 01:06:44.263624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refreshing firewall for 1 devices {{(pid=105573) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 23 01:06:44.264012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Refresh firewall rules Oct 23 01:06:44.265303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information for ports dict_keys([]) {{(pid=105573) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 23 01:06:44.265591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Update security group information {{(pid=105573) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 23 01:06:44.268749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 2 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:06:44.323191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e51cee-cccd-4197-970f-d350479fb8cd]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:06:44.324114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:574 - agent port security group processed in 0.075 Oct 23 01:06:44.325391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Setting status for 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 to UP {{(pid=105573) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 23 01:06:44.532511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up ['06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'] and devices down [] completed. Oct 23 01:06:44.533201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:574 - ports processed. Elapsed:0.300 Oct 23 01:06:44.533600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:574 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.300 Oct 23 01:06:46.235239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:575 started Oct 23 01:06:46.239760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dcc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=309000000,duration_sec=1167,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:46.240633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:46.241028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:575 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:06:48.236748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:576 started Oct 23 01:06:48.241491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=310000000,duration_sec=1169,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:48.242385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:48.242761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:576 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:06:50.237290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:577 started Oct 23 01:06:50.240813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=311000000,duration_sec=1171,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:50.241742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:50.242284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:577 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:06:52.238051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:578 started Oct 23 01:06:52.241715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=312000000,duration_sec=1173,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:52.242671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:52.242945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:578 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:06:54.238718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:579 started Oct 23 01:06:54.241791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=312000000,duration_sec=1175,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:54.242498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:54.242947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:579 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:06:56.239677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:580 started Oct 23 01:06:56.243203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=313000000,duration_sec=1177,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:56.244171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:56.244797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:580 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:06:57.271614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-dc2c3031-af7c-4ea4-bc76-9a446e56ce55 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:06:56Z,data_plane_status=None,description='',device_id='4b899082-adc8-47c5-8859-c9e024730ee6',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2ba84190-4a82-4d42-a24f-2e43fdb60add,mac_address=fa:16:3e:ad:53:5e,name='',network_id=5a7a794d-63de-41f4-a83c-d34a596efe6e,numa_affinity_policy=,project_id='abb86f1ad8d8481a9c8a8b5636d06b3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2ba84190-4a82-4d42-a24f-2e43fdb60add),security_group_ids=set([ab9eb3ca-df12-4428-a139-c340f28f0576]),status='DOWN',updated_at=2022-10-23T01:06:57Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:06:57.272330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-dc2c3031-af7c-4ea4-bc76-9a446e56ce55 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:57.272714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-dc2c3031-af7c-4ea4-bc76-9a446e56ce55 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group member updated {'ab9eb3ca-df12-4428-a139-c340f28f0576'} Oct 23 01:06:58.241482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:581 started Oct 23 01:06:58.244556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=315000000,duration_sec=1179,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:06:58.245210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:06:58.245545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:581 - starting polling. Elapsed:0.005 Oct 23 01:06:58.247435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:58.250125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:581 - port information retrieved. Elapsed:0.010 Oct 23 01:06:58.250461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:581 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:06:58.255721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5adaad26-22f4-4e42-a186-d5668bb80cb8 service neutron] Resource Port 2ba84190-4a82-4d42-a24f-2e43fdb60add updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=2ba84190-4a82-4d42-a24f-2e43fdb60add,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2ba84190-4a82-4d42-a24f-2e43fdb60add,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:58.256113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5adaad26-22f4-4e42-a186-d5668bb80cb8 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:06:58.585093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5adaad26-22f4-4e42-a186-d5668bb80cb8 service neutron] Resource Port 2ba84190-4a82-4d42-a24f-2e43fdb60add updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2ba84190-4a82-4d42-a24f-2e43fdb60add,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2ba84190-4a82-4d42-a24f-2e43fdb60add,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2ba84190-4a82-4d42-a24f-2e43fdb60add,segment=NetworkSegment(af830161-2f72-4b1d-b62f-9e0eb12ccd43),segment_id=af830161-2f72-4b1d-b62f-9e0eb12ccd43)]} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:06:58.586351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5adaad26-22f4-4e42-a186-d5668bb80cb8 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:00.242224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:582 started Oct 23 01:07:00.244970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=316000000,duration_sec=1181,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:00.245558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:00.245893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:582 - starting polling. Elapsed:0.004 Oct 23 01:07:00.247774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:00.250045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:582 - port information retrieved. Elapsed:0.008 Oct 23 01:07:00.250363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:582 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:07:02.243882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:583 started Oct 23 01:07:02.246461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ddc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=317000000,duration_sec=1183,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:02.247038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:02.247414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:583 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:04.245370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:584 started Oct 23 01:07:04.248775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=319000000,duration_sec=1185,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:04.249831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:04.250188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:584 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:07:06.245892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:585 started Oct 23 01:07:06.248590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2de0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=319000000,duration_sec=1187,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:06.249200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:06.249595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:585 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:07.038308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 2ba84190-4a82-4d42-a24f-2e43fdb60add updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:07:07.038922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:08.246764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:586 started Oct 23 01:07:08.250057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2de2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=320000000,duration_sec=1189,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:08.250740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:08.251160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:586 - starting polling. Elapsed:0.005 Oct 23 01:07:08.254099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:08.257020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:586 - port information retrieved. Elapsed:0.011 Oct 23 01:07:08.257363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:586 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:07:09.140430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 2ba84190-4a82-4d42-a24f-2e43fdb60add updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:07:09.140873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:10.248008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:587 started Oct 23 01:07:10.250731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2de4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=321000000,duration_sec=1191,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:10.251342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:10.251757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:587 - starting polling. Elapsed:0.004 Oct 23 01:07:10.253813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:10.255997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:587 - port information retrieved. Elapsed:0.008 Oct 23 01:07:10.256326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:587 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:07:12.236587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef776a17-3da7-494b-ada5-15203bded59a tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-23T01:07:11Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7ce09a46-0969-4c99-84cd-ab673e92508f,mac_address=fa:16:3e:2d:ab:92,name='',network_id=f9ff398c-cd2a-4430-b908-7f7163c266f3,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7ce09a46-0969-4c99-84cd-ab673e92508f),security_group_ids=set([]),status='N/A',updated_at=2022-10-23T01:07:11Z) {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 23 01:07:12.237393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ef776a17-3da7-494b-ada5-15203bded59a tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (7ce09a46-0969-4c99-84cd-ab673e92508f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:12.249194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:588 started Oct 23 01:07:12.251717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2de6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=323000000,duration_sec=1193,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:12.252417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:12.252928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:588 - starting polling. Elapsed:0.004 Oct 23 01:07:12.256074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:12.258663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:588 - port information retrieved. Elapsed:0.010 Oct 23 01:07:12.259024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:588 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:07:12.902438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-ef776a17-3da7-494b-ada5-15203bded59a tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource Port 7ce09a46-0969-4c99-84cd-ab673e92508f updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '2fd50acb-d50d-45fc-b795-bb77a3241035'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:07:12.902903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-ef776a17-3da7-494b-ada5-15203bded59a tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (7ce09a46-0969-4c99-84cd-ab673e92508f), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:14.249773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:589 started Oct 23 01:07:14.253072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2de8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=324000000,duration_sec=1195,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:14.254272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:14.254899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:589 - starting polling. Elapsed:0.005 Oct 23 01:07:14.257166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:07:14.259454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:589 - port information retrieved. Elapsed:0.010 Oct 23 01:07:14.259782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:589 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 23 01:07:16.251247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:590 started Oct 23 01:07:16.254019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=325000000,duration_sec=1197,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:16.254643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:16.255125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:590 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:18.252511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:591 started Oct 23 01:07:18.259244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=326000000,duration_sec=1199,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:18.260399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:18.260635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:591 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:07:20.253726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:592 started Oct 23 01:07:20.256329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=327000000,duration_sec=1201,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:20.256942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:20.257296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:592 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:22.255095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:593 started Oct 23 01:07:22.258766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2df0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=330000000,duration_sec=1203,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:22.259348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:22.260047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:593 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:07:24.257410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:594 started Oct 23 01:07:24.262814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2df2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=333000000,duration_sec=1205,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:24.263651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:24.264083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:594 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:07:26.258888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:595 started Oct 23 01:07:26.264695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2df4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=333000000,duration_sec=1207,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:26.265665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:26.266486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:595 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:07:28.260697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:596 started Oct 23 01:07:28.265569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2df6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=335000000,duration_sec=1209,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:28.266518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:28.267100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:596 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:07:30.261893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:597 started Oct 23 01:07:30.264534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2df8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=335000000,duration_sec=1211,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:30.265231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:30.265608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:597 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:32.262548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:598 started Oct 23 01:07:32.265196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dfa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=336000000,duration_sec=1213,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:32.265764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:32.266115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:598 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:34.263776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:599 started Oct 23 01:07:34.266764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dfc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=337000000,duration_sec=1215,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:34.267349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:34.267701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:599 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:36.265214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:600 started Oct 23 01:07:36.267711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2dfe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=339000000,duration_sec=1217,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:36.268288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:36.268635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:600 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:38.266552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:601 started Oct 23 01:07:38.271288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=340000000,duration_sec=1219,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:38.272282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:38.272954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:601 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:07:40.268063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:602 started Oct 23 01:07:40.272069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=342000000,duration_sec=1221,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:40.273036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:40.273283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:602 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:07:42.269163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:603 started Oct 23 01:07:42.272282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=343000000,duration_sec=1223,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:42.272878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:42.273254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:603 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:44.270467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:604 started Oct 23 01:07:44.273538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=344000000,duration_sec=1225,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:44.274233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:44.274677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:604 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:46.271761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:605 started Oct 23 01:07:46.275169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=346000000,duration_sec=1227,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:46.275766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:46.276119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:605 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:07:48.272595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:606 started Oct 23 01:07:48.275140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=346000000,duration_sec=1229,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:48.275922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:48.276325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:606 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:50.273892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:607 started Oct 23 01:07:50.276632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=347000000,duration_sec=1231,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:50.277250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:50.277603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:607 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:52.274861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:608 started Oct 23 01:07:52.282127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=348000000,duration_sec=1233,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:52.282804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:52.283156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:608 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:07:54.275834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:609 started Oct 23 01:07:54.278566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=349000000,duration_sec=1235,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:54.279254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:54.279606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:609 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:56.276519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:610 started Oct 23 01:07:56.279167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=350000000,duration_sec=1237,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:56.279758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:56.280114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:610 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:07:58.277939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:611 started Oct 23 01:07:58.281862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=352000000,duration_sec=1239,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:07:58.282386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:07:58.282995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:611 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:00.278831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:612 started Oct 23 01:08:00.282379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=352000000,duration_sec=1241,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:00.283093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:00.283549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:612 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:02.279858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:613 started Oct 23 01:08:02.282462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=353000000,duration_sec=1243,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:02.283045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:02.283421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:613 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:04.280894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:614 started Oct 23 01:08:04.284508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=354000000,duration_sec=1245,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:04.285121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:04.285477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:614 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:06.281958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:615 started Oct 23 01:08:06.284578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=355000000,duration_sec=1247,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:06.285220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:06.285573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:615 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:08.282947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:616 started Oct 23 01:08:08.285526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=356000000,duration_sec=1249,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:08.286109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:08.286463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:616 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:10.283831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:617 started Oct 23 01:08:10.286304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=357000000,duration_sec=1251,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:10.286849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:10.287202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:617 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:12.284935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:618 started Oct 23 01:08:12.287595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=358000000,duration_sec=1253,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:12.288179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:12.288530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:618 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:14.285842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:619 started Oct 23 01:08:14.289526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=359000000,duration_sec=1255,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:14.290456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:14.290805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:619 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:16.286925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:620 started Oct 23 01:08:16.289493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=360000000,duration_sec=1257,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:16.290061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:16.290402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:620 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:18.287966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:621 started Oct 23 01:08:18.290975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=361000000,duration_sec=1259,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:18.291649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:18.292145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:621 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:20.289280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:622 started Oct 23 01:08:20.292071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=363000000,duration_sec=1261,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:20.292662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:20.293049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:622 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:22.290623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:623 started Oct 23 01:08:22.293592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=364000000,duration_sec=1263,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:22.294212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:22.294566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:623 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:24.291873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:624 started Oct 23 01:08:24.294398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=365000000,duration_sec=1265,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:24.294991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:24.295412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:624 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:26.292759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:625 started Oct 23 01:08:26.300057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=366000000,duration_sec=1267,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:26.300646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:26.301019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:625 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 23 01:08:28.293789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:626 started Oct 23 01:08:28.297342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=367000000,duration_sec=1269,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:28.297998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:28.298516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:626 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:30.294808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:627 started Oct 23 01:08:30.298157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=368000000,duration_sec=1271,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:30.298750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:30.299105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:627 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:32.295656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:628 started Oct 23 01:08:32.298366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=369000000,duration_sec=1273,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:32.298945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:32.299292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:628 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:34.296984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:629 started Oct 23 01:08:34.301058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=371000000,duration_sec=1275,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:34.301988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:34.302567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:629 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:08:36.298161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:630 started Oct 23 01:08:36.300950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=372000000,duration_sec=1277,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:36.301557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:36.301923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:630 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:38.299637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:631 started Oct 23 01:08:38.303202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=373000000,duration_sec=1279,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:38.303999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:38.304465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:631 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:40.301010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:632 started Oct 23 01:08:40.304970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=375000000,duration_sec=1281,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:40.305877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:40.306617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:632 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:08:42.302277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:633 started Oct 23 01:08:42.305117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=376000000,duration_sec=1283,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:42.305760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:42.306186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:633 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:44.302999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:634 started Oct 23 01:08:44.306095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=377000000,duration_sec=1285,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:44.306790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:44.307193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:634 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:46.303817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:635 started Oct 23 01:08:46.306489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=377000000,duration_sec=1287,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:46.307057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:46.307405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:635 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:48.304856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:636 started Oct 23 01:08:48.309456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=379000000,duration_sec=1289,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:48.310394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:48.310976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:636 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:08:50.306224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:637 started Oct 23 01:08:50.309758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=380000000,duration_sec=1291,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:50.310663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:50.311236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:637 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:08:52.307875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:638 started Oct 23 01:08:52.311908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=382000000,duration_sec=1293,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:52.312959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:52.313551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:638 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:08:54.308691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:639 started Oct 23 01:08:54.311375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=382000000,duration_sec=1295,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:54.311964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:54.312318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:639 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:56.309350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:640 started Oct 23 01:08:56.311978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=383000000,duration_sec=1297,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:56.312552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:56.312960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:640 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:08:58.310075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:641 started Oct 23 01:08:58.314033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=384000000,duration_sec=1299,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:08:58.314966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:08:58.315547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:641 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:09:00.311028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:642 started Oct 23 01:09:00.315095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=385000000,duration_sec=1301,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:00.315955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:00.316299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:642 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:09:02.312790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:643 started Oct 23 01:09:02.317738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=387000000,duration_sec=1303,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:02.318735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:02.319330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:643 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:09:04.314008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:644 started Oct 23 01:09:04.318042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=388000000,duration_sec=1305,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:04.318806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:04.319300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:644 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:09:06.315397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:645 started Oct 23 01:09:06.318029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=389000000,duration_sec=1307,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:06.319030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:06.319383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:645 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:08.315958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:646 started Oct 23 01:09:08.323324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=389000000,duration_sec=1309,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:08.324415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:08.324768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:646 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:09:10.316757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:647 started Oct 23 01:09:10.319417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=390000000,duration_sec=1311,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:10.320006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:10.320370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:647 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:12.317394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:648 started Oct 23 01:09:12.320451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=391000000,duration_sec=1313,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:12.321163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:12.321573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:648 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:09:14.318202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:649 started Oct 23 01:09:14.320861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=392000000,duration_sec=1315,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:14.321472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:14.321852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:649 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:16.318822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:650 started Oct 23 01:09:16.321548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=392000000,duration_sec=1317,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:16.322224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:16.322661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:650 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:18.319548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:651 started Oct 23 01:09:18.322290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=393000000,duration_sec=1319,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:18.322867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:18.323214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:651 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:20.321381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:652 started Oct 23 01:09:20.325378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=395000000,duration_sec=1321,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:20.326104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:20.326500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:652 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:09:22.322130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:653 started Oct 23 01:09:22.325417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=395000000,duration_sec=1323,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:22.325992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:22.326344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:653 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:24.322748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:654 started Oct 23 01:09:24.325338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=396000000,duration_sec=1325,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:24.325917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:24.326269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:654 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:25.526963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 2ba84190-4a82-4d42-a24f-2e43fdb60add updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:09:25.527652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:09:26.324109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:655 started Oct 23 01:09:26.326842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=398000000,duration_sec=1327,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:26.327404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:26.327802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:655 - starting polling. Elapsed:0.004 Oct 23 01:09:26.330219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:09:26.332387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:655 - port information retrieved. Elapsed:0.008 Oct 23 01:09:26.332744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:655 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:09:28.325118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:656 started Oct 23 01:09:28.329227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=399000000,duration_sec=1329,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:28.329942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:28.330381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:656 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:09:30.326292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:657 started Oct 23 01:09:30.330367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=400000000,duration_sec=1331,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:30.331303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:30.331876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:657 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:09:32.326908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:658 started Oct 23 01:09:32.330305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=401000000,duration_sec=1333,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:32.331379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:32.332016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:658 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:09:33.612469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 2ba84190-4a82-4d42-a24f-2e43fdb60add updated (revision_number 6->7). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:09:33.613131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:09:34.328229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:659 started Oct 23 01:09:34.332814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=403000000,duration_sec=1335,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:34.333723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:34.334237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:659 - starting polling. Elapsed:0.006 Oct 23 01:09:34.337053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:09:34.340861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:659 - port information retrieved. Elapsed:0.012 Oct 23 01:09:34.340861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:659 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 23 01:09:35.589481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Resource Port 2ba84190-4a82-4d42-a24f-2e43fdb60add updated (revision_number 7->8). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105573) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 23 01:09:35.590126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-f54b7361-b0bc-4c26-82a0-2f949a510626 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-868293'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_update {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:09:36.329606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:660 started Oct 23 01:09:36.332932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=403000000,duration_sec=1337,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:36.333780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:36.334204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:660 - starting polling. Elapsed:0.005 Oct 23 01:09:36.336981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:09:36.339910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:660 - port information retrieved. Elapsed:0.011 Oct 23 01:09:36.340380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:660 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:09:38.330693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:661 started Oct 23 01:09:38.333990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=404000000,duration_sec=1339,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:38.334710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:38.335147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:661 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:09:40.331962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:662 started Oct 23 01:09:40.335247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=406000000,duration_sec=1341,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:40.335927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:40.336348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:662 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:09:42.332633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:663 started Oct 23 01:09:42.335753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=406000000,duration_sec=1343,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:42.336366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:42.336752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:663 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:09:44.333268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:664 started Oct 23 01:09:44.336081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=407000000,duration_sec=1345,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:44.336744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:44.337154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:664 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:46.334559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:665 started Oct 23 01:09:46.337134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=408000000,duration_sec=1347,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:46.337722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:46.338072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:665 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:48.335359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:666 started Oct 23 01:09:48.338282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=409000000,duration_sec=1349,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:48.338888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:48.339258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:666 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:09:50.335784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:667 started Oct 23 01:09:50.338977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=409000000,duration_sec=1351,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:50.339732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:50.340184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:667 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:09:52.337206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:668 started Oct 23 01:09:52.341284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=412000000,duration_sec=1353,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:52.342048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:52.342518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:668 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:09:54.338877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:669 started Oct 23 01:09:54.342039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=412000000,duration_sec=1355,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:54.342622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:54.342973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:669 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:09:56.340204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:670 started Oct 23 01:09:56.345281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=414000000,duration_sec=1357,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:56.346206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:56.346783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:670 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:09:58.341087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:671 started Oct 23 01:09:58.344667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=415000000,duration_sec=1359,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:09:58.346116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:09:58.346585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:671 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:00.342364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:672 started Oct 23 01:10:00.346702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=416000000,duration_sec=1361,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:00.348280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:00.348888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:672 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:10:02.343764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:673 started Oct 23 01:10:02.346931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=417000000,duration_sec=1363,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:02.347644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:02.348079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:673 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:04.345450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:674 started Oct 23 01:10:04.349380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=419000000,duration_sec=1365,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:04.350292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:04.350819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:674 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:06.345918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:675 started Oct 23 01:10:06.348431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=419000000,duration_sec=1367,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:06.349038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:06.349413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:675 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:10:08.347740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:676 started Oct 23 01:10:08.351678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=421000000,duration_sec=1369,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:08.352685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:08.353276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:676 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:10.348767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:677 started Oct 23 01:10:10.353412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=423000000,duration_sec=1371,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:10.354354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:10.354929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:677 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:12.349974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:678 started Oct 23 01:10:12.353903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=424000000,duration_sec=1373,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:12.354755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:12.355306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:678 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:14.350741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:679 started Oct 23 01:10:14.354988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=424000000,duration_sec=1375,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:14.355862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:14.356356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:679 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:16.351503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:680 started Oct 23 01:10:16.354038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2e9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=425000000,duration_sec=1377,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:16.354618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:16.354969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:680 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:10:18.352217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:681 started Oct 23 01:10:18.355298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ea0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=426000000,duration_sec=1379,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:18.356190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:18.356622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:681 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:20.353561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:682 started Oct 23 01:10:20.357955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ea2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=428000000,duration_sec=1381,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:20.358890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:20.359440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:682 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:22.354373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:683 started Oct 23 01:10:22.357139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ea4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=428000000,duration_sec=1383,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:22.357871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:22.358289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:683 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:10:24.356156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:684 started Oct 23 01:10:24.359850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ea6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=430000000,duration_sec=1385,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:24.360665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:24.361200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:684 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:26.356678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:685 started Oct 23 01:10:26.359210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ea8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=430000000,duration_sec=1387,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:26.359790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:26.360135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:685 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:10:28.357605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:686 started Oct 23 01:10:28.361332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eaa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=431000000,duration_sec=1389,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:28.362181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:28.362745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:686 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:30.359018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:687 started Oct 23 01:10:30.362409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=433000000,duration_sec=1391,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:30.363237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:30.363617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:687 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:32.360409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:688 started Oct 23 01:10:32.364582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=434000000,duration_sec=1393,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:32.365575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:32.366153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:688 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:34.361940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:689 started Oct 23 01:10:34.365957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=436000000,duration_sec=1395,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:34.366800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:34.367325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:689 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:36.363483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:690 started Oct 23 01:10:36.366084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=437000000,duration_sec=1397,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:36.366672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:36.367134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:690 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:10:38.365196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:691 started Oct 23 01:10:38.368928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=439000000,duration_sec=1399,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:38.369495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:38.369968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:691 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:40.366248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:692 started Oct 23 01:10:40.370182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=440000000,duration_sec=1401,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:40.370677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:40.371335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:692 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:42.367134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:693 started Oct 23 01:10:42.371396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=441000000,duration_sec=1403,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:42.371913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:42.372285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:693 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:44.368103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:694 started Oct 23 01:10:44.372871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=442000000,duration_sec=1405,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:44.373087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:44.373439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:694 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:10:46.119502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ceb7f8b-5ca7-481d-8435-5f1301f75be7 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource Port deleted: 7ce09a46-0969-4c99-84cd-ab673e92508f {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:46.120095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ceb7f8b-5ca7-481d-8435-5f1301f75be7 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (7ce09a46-0969-4c99-84cd-ab673e92508f), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:46.368812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:695 started Oct 23 01:10:46.372363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ebc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=443000000,duration_sec=1407,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:46.372959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:46.373284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:695 - starting polling. Elapsed:0.005 Oct 23 01:10:46.375059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:46.376255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 7ce09a46-0969-4c99-84cd-ab673e92508f not present in bridge br-int Oct 23 01:10:46.376586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:10:46.376895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['7ce09a46-0969-4c99-84cd-ab673e92508f'] Oct 23 01:10:46.377213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 7ce09a46-0969-4c99-84cd-ab673e92508f is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:10:46.379670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:695 - port information retrieved. Elapsed:0.011 Oct 23 01:10:46.380107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:695 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 23 01:10:48.370095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:696 started Oct 23 01:10:48.373768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ebe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=444000000,duration_sec=1409,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:48.374451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:48.374988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:696 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:10:48.784490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-4ad19936-089e-40ab-be0e-36acf0dc1804 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource Port deleted: 2ba84190-4a82-4d42-a24f-2e43fdb60add {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:48.784959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-4ad19936-089e-40ab-be0e-36acf0dc1804 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (2ba84190-4a82-4d42-a24f-2e43fdb60add), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:48.785362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-4ad19936-089e-40ab-be0e-36acf0dc1804 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group member updated {'ab9eb3ca-df12-4428-a139-c340f28f0576'} Oct 23 01:10:50.370756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:697 started Oct 23 01:10:50.373304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ec0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=444000000,duration_sec=1411,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:50.373884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:50.374249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:697 - starting polling. Elapsed:0.004 Oct 23 01:10:50.376411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.377656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2ba84190-4a82-4d42-a24f-2e43fdb60add not present in bridge br-int Oct 23 01:10:50.377987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:10:50.378270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['2ba84190-4a82-4d42-a24f-2e43fdb60add'] Oct 23 01:10:50.378900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 2ba84190-4a82-4d42-a24f-2e43fdb60add is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:10:50.381186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:697 - port information retrieved. Elapsed:0.011 Oct 23 01:10:50.381523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:697 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 23 01:10:50.517562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroup deleted: ab9eb3ca-df12-4428-a139-c340f28f0576 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.518059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (ab9eb3ca-df12-4428-a139-c340f28f0576), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.518626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ab9eb3ca-df12-4428-a139-c340f28f0576',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:10:50.532194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ab9eb3ca-df12-4428-a139-c340f28f0576',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:10:50.532632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: 5318c5e2-caa7-4c33-bcad-467b14f97075 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.533021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (5318c5e2-caa7-4c33-bcad-467b14f97075), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.533357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:50.533889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: fdb1d684-4c6f-4de4-83ce-05ec4d68cdd2 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.534636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (fdb1d684-4c6f-4de4-83ce-05ec4d68cdd2), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.534959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:50.535331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: 9a63daf0-7259-4bce-ada9-a68282e4569e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.535669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9a63daf0-7259-4bce-ada9-a68282e4569e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.536297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:50.536526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: 759f0de0-9c7d-4f56-8a28-513b22b936a6 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.539910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (759f0de0-9c7d-4f56-8a28-513b22b936a6), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.539910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:50.539910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: 9d30928f-62c1-4ca8-80db-07a43cc42302 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.539910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (9d30928f-62c1-4ca8-80db-07a43cc42302), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.540293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:50.540293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: b8b62cdb-f3e9-4899-9060-b8fc90f5bff8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.540293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (b8b62cdb-f3e9-4899-9060-b8fc90f5bff8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.540293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:50.540293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: a2d47f81-87a1-4137-b1f5-dda1dae6cf4a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.540682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a2d47f81-87a1-4137-b1f5-dda1dae6cf4a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.540799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:50.541119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Resource SecurityGroupRule deleted: a563f972-a8fd-42d0-a38f-97a5e0af4c42 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:50.541448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a563f972-a8fd-42d0-a38f-97a5e0af4c42), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:50.541754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-fdd039ce-591f-4de9-a3df-cded0b182815 tempest-TestShelveInstance-126243353 tempest-TestShelveInstance-126243353-project] Security group rule updated ['ab9eb3ca-df12-4428-a139-c340f28f0576'] Oct 23 01:10:51.434394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-68902c12-5e62-439b-949c-afda74b00bf7 admin admin] Resource Port deleted: 52613b17-dcae-463f-82de-070ab81aef6a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:51.435073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-68902c12-5e62-439b-949c-afda74b00bf7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (52613b17-dcae-463f-82de-070ab81aef6a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:52.371994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:698 started Oct 23 01:10:52.376096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ec2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=446000000,duration_sec=1413,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:52.377272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:52.377843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:698 - starting polling. Elapsed:0.006 Oct 23 01:10:52.380398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:52.383567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-52613b17-dc, col_values=(('tag', 4095),)) {{(pid=105573) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 23 01:10:52.392277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ec4,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3728779868001237721,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:52.393173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for ['52613b17-dcae-463f-82de-070ab81aef6a'] Oct 23 01:10:52.393826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:10:52.476022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[2734c4f0-4a3b-4fba-9f83-d9a385c5ea9a]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:10:52.479181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:698 - port information retrieved. Elapsed:0.107 Oct 23 01:10:52.479926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:698 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.108 Oct 23 01:10:52.550406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-6cb0343e-30c9-4119-9a9c-e723ad7ea00e admin admin] Resource Port deleted: 29e200d5-6454-43fe-8518-99a7bf660c1a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:52.551217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-6cb0343e-30c9-4119-9a9c-e723ad7ea00e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (29e200d5-6454-43fe-8518-99a7bf660c1a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:52.579539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9ce14450-ca35-4d93-a902-8223534b0da7","delete","qr-52613b17-dc",36,["map",[["attached-mac","fa:16:3e:00:10:f6"],["iface-id","52613b17-dcae-463f-82de-070ab81aef6a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:10:52.998966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d062bdd2-b5e8-4f0c-950c-5a847b9fa717","delete","qg-29e200d5-64",34,["map",[["attached-mac","fa:16:3e:ee:41:1a"],["iface-id","29e200d5-6454-43fe-8518-99a7bf660c1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:10:53.046603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-3142b5c0-5aba-4f37-8842-14efc400072f admin admin] Resource Subnet deleted: 3d59b4dc-5424-4479-a128-51bbe59fdc02 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:53.046970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-3142b5c0-5aba-4f37-8842-14efc400072f admin admin] Publish callbacks [] for Subnet (3d59b4dc-5424-4479-a128-51bbe59fdc02), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:53.197581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["02839ce0-c86e-44ec-8ce3-cd51d293de37","delete","taped08c520-d2",33,["map",[["attached-mac","fa:16:3e:b7:d4:14"],["iface-id","ed08c520-d224-4010-b30f-1caee6c4d7a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:10:53.521443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5bfaa046-5c03-4e3b-a7fd-a4acca182098 None None] Resource Port deleted: ed08c520-d224-4010-b30f-1caee6c4d7a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:53.522389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5bfaa046-5c03-4e3b-a7fd-a4acca182098 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (ed08c520-d224-4010-b30f-1caee6c4d7a8), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:53.676805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5f07f731-15d3-4cea-9c38-97836b3d8529 admin admin] Resource Port deleted: ed08c520-d224-4010-b30f-1caee6c4d7a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:53.677233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5f07f731-15d3-4cea-9c38-97836b3d8529 admin admin] Skipped duplicate delete event for ed08c520-d224-4010-b30f-1caee6c4d7a8 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:10:53.917555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-5f07f731-15d3-4cea-9c38-97836b3d8529 admin admin] Resource Network deleted: 5a7a794d-63de-41f4-a83c-d34a596efe6e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:53.917931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-5f07f731-15d3-4cea-9c38-97836b3d8529 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (5a7a794d-63de-41f4-a83c-d34a596efe6e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:54.373409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:699 started Oct 23 01:10:54.376303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ec6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=447000000,duration_sec=1415,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:54.377026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:54.377654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:699 - starting polling. Elapsed:0.004 Oct 23 01:10:54.379467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:54.382890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ec8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:54.385349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2eca,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:54.387154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ecc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:54.387453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:699 - port information retrieved. Elapsed:0.014 Oct 23 01:10:54.387792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '36027a75-3b26-4728-a464-23e4dbba5d4a', '99db7be1-e4dc-4662-a5bb-e94fd92d7e45'}, 'added': set(), 'removed': {'ed08c520-d224-4010-b30f-1caee6c4d7a8', '29e200d5-6454-43fe-8518-99a7bf660c1a', '52613b17-dcae-463f-82de-070ab81aef6a'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:10:54.388113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:699 - agent port security group processed in 0.000 Oct 23 01:10:54.389613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:10:54.389938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'ed08c520-d224-4010-b30f-1caee6c4d7a8', '29e200d5-6454-43fe-8518-99a7bf660c1a', '52613b17-dcae-463f-82de-070ab81aef6a'} Oct 23 01:10:54.390347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port 52613b17-dcae-463f-82de-070ab81aef6a is not handled by the firewall. {{(pid=105573) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 23 01:10:54.390914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:10:54.429451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba6d09-a4e9-49a5-8869-aafef4147932]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:10:54.430083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'ed08c520-d224-4010-b30f-1caee6c4d7a8', '29e200d5-6454-43fe-8518-99a7bf660c1a', '52613b17-dcae-463f-82de-070ab81aef6a'} removed Oct 23 01:10:54.498615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:10:54.499117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 13 from net-id = 5a7a794d-63de-41f4-a83c-d34a596efe6e, seg-id = 369 Oct 23 01:10:54.502571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x13211955,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:54.505343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2ece,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4465}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:54.505876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] net_uuid None not managed by VLAN manager Oct 23 01:10:54.506234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:699 - treat_devices_removed completed in 0.116 Oct 23 01:10:54.506586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:699 - ports processed. Elapsed:0.133 Oct 23 01:10:54.506919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:699 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.134 Oct 23 01:10:54.783170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-03d0cfc8-1072-48b3-ae5b-2bae259e90b8 admin admin] Resource Port deleted: 06df1483-bd9e-4eb6-88e8-3ef5747f9fd5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:54.784272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-03d0cfc8-1072-48b3-ae5b-2bae259e90b8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (06df1483-bd9e-4eb6-88e8-3ef5747f9fd5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:55.861093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-72f1376d-e38d-4492-98c8-0245b9c494a8 admin admin] Resource Port deleted: 99db7be1-e4dc-4662-a5bb-e94fd92d7e45 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:55.861976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-72f1376d-e38d-4492-98c8-0245b9c494a8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (99db7be1-e4dc-4662-a5bb-e94fd92d7e45), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:55.886427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["204a5f9b-8d50-4315-83c3-498d13be345a","delete","qr-06df1483-bd",38,["map",[["attached-mac","fa:16:3e:bd:d1:aa"],["iface-id","06df1483-bd9e-4eb6-88e8-3ef5747f9fd5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:10:56.280379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5fca1397-c53f-4bf2-b2c6-2baa40f3f2b4","delete","qg-99db7be1-e4",37,["map",[["attached-mac","fa:16:3e:23:62:37"],["iface-id","99db7be1-e4dc-4662-a5bb-e94fd92d7e45"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:10:56.374233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:700 started Oct 23 01:10:56.571153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b5102cfe-2076-4436-8adf-f443b4df9246 admin admin] Resource Subnet deleted: 5b676e81-ae04-4245-a21a-f4742a1bad4d {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:56.575017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b5102cfe-2076-4436-8adf-f443b4df9246 admin admin] Publish callbacks [] for Subnet (5b676e81-ae04-4245-a21a-f4742a1bad4d), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:56.579611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ed0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=642000000,duration_sec=1417,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:56.579611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:56.579611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:700 - starting polling. Elapsed:0.206 Oct 23 01:10:56.581621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:56.584812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ed2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:56.586911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ed4,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:56.587182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:700 - port information retrieved. Elapsed:0.213 Oct 23 01:10:56.587701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '9ec59cc1-5f76-46ca-bc46-9da595ea58e5', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': set(), 'removed': {'99db7be1-e4dc-4662-a5bb-e94fd92d7e45', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:10:56.588142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:700 - agent port security group processed in 0.000 Oct 23 01:10:56.589457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:10:56.589927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'99db7be1-e4dc-4662-a5bb-e94fd92d7e45', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'} Oct 23 01:10:56.590421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 8 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:10:56.647004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[850aa371-a93d-4e12-94f6-4b75349d969e]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:10:56.648522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'99db7be1-e4dc-4662-a5bb-e94fd92d7e45', '06df1483-bd9e-4eb6-88e8-3ef5747f9fd5'} removed Oct 23 01:10:56.723512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:10:56.724247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:700 - treat_devices_removed completed in 0.134 Oct 23 01:10:56.724709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:700 - ports processed. Elapsed:0.351 Oct 23 01:10:56.725237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:700 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.351 Oct 23 01:10:56.754587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["efd939bd-cb44-4623-a74d-b9976d3dd2ed","delete","tap9ec59cc1-5f",35,["map",[["attached-mac","fa:16:3e:53:0d:1b"],["iface-id","9ec59cc1-5f76-46ca-bc46-9da595ea58e5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105573) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 23 01:10:56.913034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b8d172a3-5578-4bce-b4a2-a7efc4b311bf admin admin] Resource Port deleted: 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:56.913717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b8d172a3-5578-4bce-b4a2-a7efc4b311bf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-868302'] for Port (9ec59cc1-5f76-46ca-bc46-9da595ea58e5), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:57.013095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fcc08075-4a08-4d21-982a-2b1e9e820344 None None] Resource Port deleted: 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:57.013425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-fcc08075-4a08-4d21-982a-2b1e9e820344 None None] Skipped duplicate delete event for 9ec59cc1-5f76-46ca-bc46-9da595ea58e5 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 23 01:10:57.150992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-b8d172a3-5578-4bce-b4a2-a7efc4b311bf admin admin] Resource Network deleted: 82a5267c-a1eb-4074-8b8c-eaaf871b7c4a {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:57.151694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-b8d172a3-5578-4bce-b4a2-a7efc4b311bf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-852960'] for Network (82a5267c-a1eb-4074-8b8c-eaaf871b7c4a), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:57.500370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Resource SecurityGroup deleted: be6f606d-5902-4115-b7e0-6435c12cf7b7 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:57.500764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (be6f606d-5902-4115-b7e0-6435c12cf7b7), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:57.501446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('be6f606d-5902-4115-b7e0-6435c12cf7b7',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:10:57.520696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('be6f606d-5902-4115-b7e0-6435c12cf7b7',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:10:57.521174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Resource SecurityGroupRule deleted: 7aeca448-f99e-4dd6-b0ec-165533f7ca50 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:57.521624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (7aeca448-f99e-4dd6-b0ec-165533f7ca50), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:57.522020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:10:57.522475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Resource SecurityGroupRule deleted: a794a9df-a24c-4748-8971-931b09ab6f17 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:57.522874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (a794a9df-a24c-4748-8971-931b09ab6f17), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:57.523230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:10:57.523577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Resource SecurityGroupRule deleted: d05dcd77-641f-40d5-afb7-684f06d69c7e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:57.523905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (d05dcd77-641f-40d5-afb7-684f06d69c7e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:57.524222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:10:57.524583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Resource SecurityGroupRule deleted: e70102d1-5694-423a-83c0-42f2abaeec15 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:57.524936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (e70102d1-5694-423a-83c0-42f2abaeec15), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:57.525266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-de14fc7d-ad67-4f52-82da-1f52eebbdf95 admin admin] Security group rule updated ['be6f606d-5902-4115-b7e0-6435c12cf7b7'] Oct 23 01:10:58.058042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Resource SecurityGroup deleted: b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:58.058708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-868321'] for SecurityGroup (b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:58.059154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e',)}} {{(pid=105573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 23 01:10:58.073247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e',)))} {{(pid=105573) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 23 01:10:58.073739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Resource SecurityGroupRule deleted: 0a39b9d5-6262-416d-bfe0-e68ad59ad0eb {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:58.074182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0a39b9d5-6262-416d-bfe0-e68ad59ad0eb), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:58.074572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:10:58.075166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Resource SecurityGroupRule deleted: 0a3f29df-1284-40f8-ba43-d92892fe4726 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:58.075512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (0a3f29df-1284-40f8-ba43-d92892fe4726), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:58.075837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:10:58.076209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Resource SecurityGroupRule deleted: 155d3202-6496-465d-9ff2-fcfeb9313295 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:58.076554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (155d3202-6496-465d-9ff2-fcfeb9313295), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:58.076925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:10:58.077323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.resource_cache [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Resource SecurityGroupRule deleted: 488e176b-6495-4c63-912c-73b899337e22 {{(pid=105573) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 23 01:10:58.077666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-868344'] for SecurityGroupRule (488e176b-6495-4c63-912c-73b899337e22), after_delete {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:58.078006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-872c9530-5eea-4534-9017-8f1e2556c7f1 admin admin] Security group rule updated ['b47e4d7d-2f6d-40d6-8c24-9b2f4c3f850e'] Oct 23 01:10:58.375442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:701 started Oct 23 01:10:58.380403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ed6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=451000000,duration_sec=1419,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:58.381050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:10:58.381454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:701 - starting polling. Elapsed:0.006 Oct 23 01:10:58.382943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron_lib.callbacks.manager [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-946934'] for ovsdb (None), after_read {{(pid=105573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 23 01:10:58.386182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5fee2ed8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:58.386492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:701 - port information retrieved. Elapsed:0.011 Oct 23 01:10:58.386931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Starting to process devices in:{'current': {'0db4d4c4-d261-4750-963a-1eb2bdb77e41', '8edb9f18-7960-4eae-89c3-6b941ce63ba3', '87cfa4c1-a876-469a-b6ca-e739a6b2f813', '36027a75-3b26-4728-a464-23e4dbba5d4a'}, 'added': set(), 'removed': {'9ec59cc1-5f76-46ca-bc46-9da595ea58e5'}, 'updated': set(), 're_added': set()} {{(pid=105573) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 23 01:10:58.387234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:701 - agent port security group processed in 0.000 Oct 23 01:10:58.388287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Configuration for devices up [] and devices down [] completed. Oct 23 01:10:58.388583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.agent.securitygroups_rpc [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Remove device filter for {'9ec59cc1-5f76-46ca-bc46-9da595ea58e5'} Oct 23 01:10:58.389065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.common.ovs_lib [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Processing 4 OpenFlow rules. {{(pid=105573) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:574}} Oct 23 01:10:58.427570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57c5fc7-5cb6-4ea6-88a7-53be1be873a2]: (4, ('', '', 0)) {{(pid=107272) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 23 01:10:58.428555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Ports {'9ec59cc1-5f76-46ca-bc46-9da595ea58e5'} removed Oct 23 01:10:58.456503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Port removal failed for set() {{(pid=105573) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 23 01:10:58.457028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Reclaiming vlan = 14 from net-id = 82a5267c-a1eb-4074-8b8c-eaaf871b7c4a, seg-id = 389 Oct 23 01:10:58.460105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x13211957,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17615684023133517336,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:58.462950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x5fee2eda,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3728779868001237721,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4485}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:10:58.463285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] process_network_ports - iteration:701 - treat_devices_removed completed in 0.075 Oct 23 01:10:58.463581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:701 - ports processed. Elapsed:0.088 Oct 23 01:10:58.463916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:701 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.089 Oct 23 01:11:00.376761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:702 started Oct 23 01:11:00.380246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2edc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=450000000,duration_sec=1421,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:00.380994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:00.381358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:702 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:02.377492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:703 started Oct 23 01:11:02.380921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ede,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=451000000,duration_sec=1423,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:02.381519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:02.381877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:703 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:04.379192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:704 started Oct 23 01:11:04.382307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ee0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=453000000,duration_sec=1425,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:04.382903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:04.383251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:704 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:06.380009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:705 started Oct 23 01:11:06.383010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ee2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=454000000,duration_sec=1427,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:06.383694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:06.384566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:705 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:08.381008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:706 started Oct 23 01:11:08.384065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ee4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=454000000,duration_sec=1429,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:08.384637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:08.385019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:706 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:10.382870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:707 started Oct 23 01:11:10.386135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ee6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=456000000,duration_sec=1431,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:10.386959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:10.387453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:707 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:12.383275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:708 started Oct 23 01:11:12.385975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ee8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=457000000,duration_sec=1433,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:12.386560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:12.386917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:708 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:14.384654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:709 started Oct 23 01:11:14.387493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=458000000,duration_sec=1435,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:14.388074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:14.388451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:709 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:16.385346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:710 started Oct 23 01:11:16.388509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=459000000,duration_sec=1437,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:16.389429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:16.389806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:710 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:18.386590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:711 started Oct 23 01:11:18.389386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2eee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=460000000,duration_sec=1439,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:18.389965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:18.390317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:711 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:20.387027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:712 started Oct 23 01:11:20.389653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ef0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=460000000,duration_sec=1441,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:20.390223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:20.390638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:712 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:22.387953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:713 started Oct 23 01:11:22.390911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ef2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=462000000,duration_sec=1443,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:22.391518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:22.391883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:713 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:24.389620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:714 started Oct 23 01:11:24.392786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ef4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=463000000,duration_sec=1445,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:24.393566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:24.394043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:714 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:26.390934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:715 started Oct 23 01:11:26.393946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ef6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=465000000,duration_sec=1447,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:26.394532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:26.394882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:715 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:28.391706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:716 started Oct 23 01:11:28.394310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ef8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=465000000,duration_sec=1449,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:28.394885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:28.395231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:716 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:30.394418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:717 started Oct 23 01:11:30.396930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2efa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=468000000,duration_sec=1451,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:30.397502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:30.397849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:717 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:11:32.393406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:718 started Oct 23 01:11:32.396509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2efc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=467000000,duration_sec=1453,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:32.397125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:32.397862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:718 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:34.394399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:719 started Oct 23 01:11:34.397549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2efe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=468000000,duration_sec=1455,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:34.398365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:34.398802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:719 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:36.395716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:720 started Oct 23 01:11:36.398255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=469000000,duration_sec=1457,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:36.398814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:36.399192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:720 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:38.397189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:721 started Oct 23 01:11:38.399840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=471000000,duration_sec=1459,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:38.400419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:38.400768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:721 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:40.398463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:722 started Oct 23 01:11:40.401124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=472000000,duration_sec=1461,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:40.401720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:40.402073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:722 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:42.399878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:723 started Oct 23 01:11:42.402868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=474000000,duration_sec=1463,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:42.403624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:42.404121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:723 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:44.400603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:724 started Oct 23 01:11:44.403359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=474000000,duration_sec=1465,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:44.403972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:44.404329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:724 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:46.401211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:725 started Oct 23 01:11:46.403863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=475000000,duration_sec=1467,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:46.404453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:46.404846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:725 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:48.402437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:726 started Oct 23 01:11:48.405399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=476000000,duration_sec=1469,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:48.405971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:48.406381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:726 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:50.402918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:727 started Oct 23 01:11:50.406240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=477000000,duration_sec=1471,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:50.406939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:50.407329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:727 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:52.404242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:728 started Oct 23 01:11:52.409209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=479000000,duration_sec=1473,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:52.410111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:52.410678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:728 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:11:54.404936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:729 started Oct 23 01:11:54.408657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=479000000,duration_sec=1475,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:54.409732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:54.410093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:729 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:11:56.405924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:730 started Oct 23 01:11:56.408708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=480000000,duration_sec=1477,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:56.409321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:56.409676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:730 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:11:58.406509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:731 started Oct 23 01:11:58.409027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=480000000,duration_sec=1479,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:11:58.409640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:11:58.409989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:731 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:00.407722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:732 started Oct 23 01:12:00.410283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=481000000,duration_sec=1481,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:00.410959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:00.411337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:732 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:02.409076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:733 started Oct 23 01:12:02.412011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=483000000,duration_sec=1483,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:02.412601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:02.412989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:733 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:04.410326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:734 started Oct 23 01:12:04.412914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=484000000,duration_sec=1485,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:04.413798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:04.414165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:734 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:06.411506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:735 started Oct 23 01:12:06.414613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=485000000,duration_sec=1487,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:06.415308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:06.415714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:735 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:12:08.412704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:736 started Oct 23 01:12:08.415293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=486000000,duration_sec=1489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:08.415873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:08.416225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:736 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:10.413755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:737 started Oct 23 01:12:10.416269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=487000000,duration_sec=1491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:10.416920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:10.417277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:737 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:12.414860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:738 started Oct 23 01:12:12.417514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=488000000,duration_sec=1493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:12.418114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:12.418581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:738 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:14.416423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:739 started Oct 23 01:12:14.419379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=490000000,duration_sec=1495,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:14.419968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:14.420324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:739 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:16.417235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:740 started Oct 23 01:12:16.420361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=491000000,duration_sec=1497,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:16.421111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:16.421518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:740 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:12:18.418680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:741 started Oct 23 01:12:18.421332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=492000000,duration_sec=1499,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:18.421925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:18.422280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:741 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:20.419820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:742 started Oct 23 01:12:20.422361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=493000000,duration_sec=1501,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:20.422945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:20.423294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:742 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:22.421229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:743 started Oct 23 01:12:22.424306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=495000000,duration_sec=1503,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:22.424940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:22.425299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:743 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:24.421874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:744 started Oct 23 01:12:24.424868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=495000000,duration_sec=1505,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:24.425455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:24.425823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:744 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:26.422430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:745 started Oct 23 01:12:26.425035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=496000000,duration_sec=1507,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:26.425614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:26.425994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:745 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:28.423745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:746 started Oct 23 01:12:28.426573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=497000000,duration_sec=1509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:28.427451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:28.427855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:746 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:30.425058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:747 started Oct 23 01:12:30.427979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=498000000,duration_sec=1511,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:30.428492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:30.428914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:747 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:32.425950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:748 started Oct 23 01:12:32.428431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=499000000,duration_sec=1513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:32.429038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:32.429383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:748 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:34.427099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:749 started Oct 23 01:12:34.429693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=500000000,duration_sec=1515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:34.430279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:34.430635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:749 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:36.427943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:750 started Oct 23 01:12:36.430890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=502000000,duration_sec=1517,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:36.431495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:36.431845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:750 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:38.429446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:751 started Oct 23 01:12:38.433108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=503000000,duration_sec=1519,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:38.433822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:38.434164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:751 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:12:40.430121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:752 started Oct 23 01:12:40.433076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=504000000,duration_sec=1521,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:40.433673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:40.434032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:752 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:42.431213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:753 started Oct 23 01:12:42.433613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=505000000,duration_sec=1523,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:42.434189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:42.434536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:753 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:44.432433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:754 started Oct 23 01:12:44.435447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=506000000,duration_sec=1525,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:44.436025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:44.436377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:754 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:46.433996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:755 started Oct 23 01:12:46.438094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=508000000,duration_sec=1527,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:46.438919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:46.439449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:755 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:12:48.434769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:756 started Oct 23 01:12:48.437875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=508000000,duration_sec=1529,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:48.438442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:48.438819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:756 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:50.435866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:757 started Oct 23 01:12:50.443427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=509000000,duration_sec=1531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:50.444076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:50.444436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:757 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:12:52.437266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:758 started Oct 23 01:12:52.440524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=510000000,duration_sec=1533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:52.441389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:52.441870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:758 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:12:54.438047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:759 started Oct 23 01:12:54.440692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=511000000,duration_sec=1535,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:54.441333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:54.441732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:759 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:12:56.439177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:760 started Oct 23 01:12:56.442613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=513000000,duration_sec=1537,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:56.443221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:56.443567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:760 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:12:58.440580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:761 started Oct 23 01:12:58.443317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=514000000,duration_sec=1539,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:12:58.444041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:12:58.444387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:761 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:00.441476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:762 started Oct 23 01:13:00.444048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=515000000,duration_sec=1541,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:00.444614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:00.444983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:762 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:02.443046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:763 started Oct 23 01:13:02.446973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=517000000,duration_sec=1543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:02.447872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:02.448652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:763 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:13:04.444353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:764 started Oct 23 01:13:04.446911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=518000000,duration_sec=1545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:04.447483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:04.447834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:764 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:06.445840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:765 started Oct 23 01:13:06.448759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=519000000,duration_sec=1547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:06.449371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:06.449758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:765 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:08.446987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:766 started Oct 23 01:13:08.450427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=520000000,duration_sec=1549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:08.451640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:08.459276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:766 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:13:10.455090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:767 started Oct 23 01:13:10.457843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=528000000,duration_sec=1551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:10.458490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:10.459032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:767 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:12.455955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:768 started Oct 23 01:13:12.459845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=530000000,duration_sec=1553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:12.460841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:12.461295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:768 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:13:14.456791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:769 started Oct 23 01:13:14.460413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=530000000,duration_sec=1555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:14.461445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:14.462066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:769 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:13:16.458109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:770 started Oct 23 01:13:16.461161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=531000000,duration_sec=1557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:16.461746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:16.462103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:770 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:18.459253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:771 started Oct 23 01:13:18.461883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=532000000,duration_sec=1559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:18.462466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:18.462824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:771 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:20.460180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:772 started Oct 23 01:13:20.463237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=534000000,duration_sec=1561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:20.463863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:20.464221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:772 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:22.461255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:773 started Oct 23 01:13:22.463859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=535000000,duration_sec=1563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:22.464470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:22.464884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:773 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:24.462260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:774 started Oct 23 01:13:24.465014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=536000000,duration_sec=1565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:24.465602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:24.465963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:774 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:26.463613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:775 started Oct 23 01:13:26.467084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=537000000,duration_sec=1567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:26.467643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:26.468254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:775 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:13:28.464506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:776 started Oct 23 01:13:28.467105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=538000000,duration_sec=1569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:28.467696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:28.468018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:776 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:30.466205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:777 started Oct 23 01:13:30.468038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=539000000,duration_sec=1571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:30.468648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:30.469134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:777 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:32.466345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:778 started Oct 23 01:13:32.469055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=540000000,duration_sec=1573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:32.469646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:32.470004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:778 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:34.467611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:779 started Oct 23 01:13:34.471179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=541000000,duration_sec=1575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:34.471959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:34.472461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:779 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:13:36.468274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:780 started Oct 23 01:13:36.472861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=543000000,duration_sec=1577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:36.473740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:36.474302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:780 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:13:38.469970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:781 started Oct 23 01:13:38.472553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=543000000,duration_sec=1579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:38.473174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:38.473533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:781 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:40.470540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:782 started Oct 23 01:13:40.473708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=544000000,duration_sec=1581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:40.474354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:40.475138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:782 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:13:42.471368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:783 started Oct 23 01:13:42.474007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=545000000,duration_sec=1583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:42.474616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:42.474969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:783 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:44.472549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:784 started Oct 23 01:13:44.475118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=546000000,duration_sec=1585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:44.475731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:44.476067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:784 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:46.474077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:785 started Oct 23 01:13:46.477440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=547000000,duration_sec=1587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:46.478231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:46.478642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:785 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:13:48.474397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:786 started Oct 23 01:13:48.477027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=548000000,duration_sec=1589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:48.477630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:48.477973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:786 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:50.475178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:787 started Oct 23 01:13:50.477706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=549000000,duration_sec=1591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:50.478284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:50.478635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:787 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:52.476338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:788 started Oct 23 01:13:52.478887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=550000000,duration_sec=1593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:52.479482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:52.479838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:788 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:54.477123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:789 started Oct 23 01:13:54.479963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=551000000,duration_sec=1595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:54.480577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:54.480973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:789 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:56.478083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:790 started Oct 23 01:13:56.480782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=552000000,duration_sec=1597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:56.481397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:56.481741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:790 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:13:58.478529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:791 started Oct 23 01:13:58.481301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=552000000,duration_sec=1599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:13:58.481955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:13:58.482502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:791 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:00.479928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:792 started Oct 23 01:14:00.484274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=554000000,duration_sec=1601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:00.485381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:00.486064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:792 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 23 01:14:02.481240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:793 started Oct 23 01:14:02.484814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=555000000,duration_sec=1603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:02.485727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:02.486271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:793 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:14:04.481747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:794 started Oct 23 01:14:04.484407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=555000000,duration_sec=1605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:04.485029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:04.485386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:794 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:06.482627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:795 started Oct 23 01:14:06.485371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=556000000,duration_sec=1607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:06.485986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:06.486319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:795 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:08.483554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:796 started Oct 23 01:14:08.486355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=557000000,duration_sec=1609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:08.487506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:08.488286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:796 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:10.484384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:797 started Oct 23 01:14:10.488543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=558000000,duration_sec=1611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:10.489380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:10.490054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:797 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:14:12.485337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:798 started Oct 23 01:14:12.488015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=559000000,duration_sec=1613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:12.488629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:12.489054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:798 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:14.486218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:799 started Oct 23 01:14:14.489323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2f9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=560000000,duration_sec=1615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:14.489946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:14.490276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:799 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:16.487030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:800 started Oct 23 01:14:16.489752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fa0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=560000000,duration_sec=1617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:16.490350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:16.490703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:800 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:18.487759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:801 started Oct 23 01:14:18.490350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fa2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=561000000,duration_sec=1619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:18.490946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:18.491311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:801 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:20.489192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:802 started Oct 23 01:14:20.492700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fa4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=563000000,duration_sec=1621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:20.493561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:20.494069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:802 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:14:22.490466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:803 started Oct 23 01:14:22.493087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fa6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=564000000,duration_sec=1623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:22.493783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:22.494145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:803 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:24.491683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:804 started Oct 23 01:14:24.495915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fa8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=566000000,duration_sec=1625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:24.496974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:24.497515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:804 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:14:26.492835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:805 started Oct 23 01:14:26.495593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2faa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=566000000,duration_sec=1627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:26.496169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:26.496535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:805 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:28.494183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:806 started Oct 23 01:14:28.496686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=567000000,duration_sec=1629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:28.497296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:28.497656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:806 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:30.495052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:807 started Oct 23 01:14:30.497973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=569000000,duration_sec=1631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:30.498563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:30.498943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:807 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:32.496543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:808 started Oct 23 01:14:32.499473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=570000000,duration_sec=1633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:32.500073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:32.500422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:808 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:34.497442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:809 started Oct 23 01:14:34.501078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=571000000,duration_sec=1635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:34.502001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:34.502629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:809 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:14:36.498774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:810 started Oct 23 01:14:36.501867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=573000000,duration_sec=1637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:36.502435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:36.502944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:810 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:38.499962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:811 started Oct 23 01:14:38.502521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=573000000,duration_sec=1639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:38.503106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:38.503458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:811 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:40.501525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:812 started Oct 23 01:14:40.504689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=575000000,duration_sec=1641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:40.505374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:40.505751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:812 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:14:42.501747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:813 started Oct 23 01:14:42.504461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=575000000,duration_sec=1643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:42.505278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:42.505729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:813 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:44.502509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:814 started Oct 23 01:14:44.506285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=576000000,duration_sec=1645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:44.507075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:44.507571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:814 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:14:46.503266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:815 started Oct 23 01:14:46.507324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=577000000,duration_sec=1647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:46.508160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:46.508645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:815 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:14:48.504824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:816 started Oct 23 01:14:48.507827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=578000000,duration_sec=1649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:48.508012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:48.509391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:816 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:50.507597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:817 started Oct 23 01:14:50.510532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=580000000,duration_sec=1651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:50.511584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:50.512005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:817 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:14:52.507639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:818 started Oct 23 01:14:52.510304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=581000000,duration_sec=1653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:52.510959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:52.511325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:818 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:54.508158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:819 started Oct 23 01:14:54.511539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=582000000,duration_sec=1655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:54.512173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:54.512567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:819 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:14:56.509061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:820 started Oct 23 01:14:56.511564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=582000000,duration_sec=1657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:56.512141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:56.512522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:820 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:14:58.510256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:821 started Oct 23 01:14:58.512960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=584000000,duration_sec=1659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:14:58.513559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:14:58.513925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:821 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:00.511662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:822 started Oct 23 01:15:00.514291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fcc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=585000000,duration_sec=1661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:00.514877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:00.515233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:822 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:02.512409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:823 started Oct 23 01:15:02.515239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=586000000,duration_sec=1663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:02.515830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:02.516185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:823 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:04.513650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:824 started Oct 23 01:15:04.517170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=587000000,duration_sec=1665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:04.517797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:04.518191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:824 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:15:06.514816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:825 started Oct 23 01:15:06.517858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=588000000,duration_sec=1667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:06.518586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:06.519144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:825 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:08.516251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:826 started Oct 23 01:15:08.518890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=590000000,duration_sec=1669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:08.519490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:08.519858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:826 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:10.517709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:827 started Oct 23 01:15:10.521041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=591000000,duration_sec=1671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:10.521640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:10.522010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:827 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:15:12.519012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:828 started Oct 23 01:15:12.521795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=593000000,duration_sec=1673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:12.522403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:12.522762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:828 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:14.519878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:829 started Oct 23 01:15:14.522803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=594000000,duration_sec=1675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:14.523421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:14.523778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:829 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:16.521312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:830 started Oct 23 01:15:16.523893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fdc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=595000000,duration_sec=1677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:16.524531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:16.524919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:830 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:18.522349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:831 started Oct 23 01:15:18.524984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=596000000,duration_sec=1679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:18.525609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:18.525967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:831 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:20.523270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:832 started Oct 23 01:15:20.526260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fe0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=597000000,duration_sec=1681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:20.526835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:20.527192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:832 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:22.523934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:833 started Oct 23 01:15:22.526731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fe2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=598000000,duration_sec=1683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:22.527352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:22.527839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:833 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:24.525305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:834 started Oct 23 01:15:24.527905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fe4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=599000000,duration_sec=1685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:24.528541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:24.528940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:834 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:26.526506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:835 started Oct 23 01:15:26.529300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fe6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=600000000,duration_sec=1687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:26.529886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:26.530259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:835 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:28.527105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:836 started Oct 23 01:15:28.529544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fe8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=600000000,duration_sec=1689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:28.530128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:28.530492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:836 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:30.528519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:837 started Oct 23 01:15:30.531245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=602000000,duration_sec=1691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:30.531828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:30.532180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:837 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:32.529917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:838 started Oct 23 01:15:32.533441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=603000000,duration_sec=1693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:32.534298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:32.534874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:838 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:15:34.531417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:839 started Oct 23 01:15:34.533934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2fee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=605000000,duration_sec=1695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:34.534597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:34.534942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:839 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:36.532769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:840 started Oct 23 01:15:36.536580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ff0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=607000000,duration_sec=1697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:36.537170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:36.537611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:840 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:15:38.533535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:841 started Oct 23 01:15:38.536142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ff2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=607000000,duration_sec=1699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:38.536854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:38.537242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:841 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:40.534626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:842 started Oct 23 01:15:40.537401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ff4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=608000000,duration_sec=1701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:40.538016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:40.538395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:842 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:42.535459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:843 started Oct 23 01:15:42.538074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ff6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=609000000,duration_sec=1703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:42.538658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:42.539010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:843 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:44.537241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:844 started Oct 23 01:15:44.540958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ff8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=611000000,duration_sec=1705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:44.541777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:44.542309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:844 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:15:46.538309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:845 started Oct 23 01:15:46.541155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ffa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=612000000,duration_sec=1707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:46.541798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:46.542155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:845 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:48.538789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:846 started Oct 23 01:15:48.541523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ffc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=612000000,duration_sec=1709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:48.542106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:48.542465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:846 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:50.540155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:847 started Oct 23 01:15:50.542755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee2ffe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=614000000,duration_sec=1711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:50.543334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:50.543684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:847 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:52.541086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:848 started Oct 23 01:15:52.543569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3000,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=614000000,duration_sec=1713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:52.544170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:52.544515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:848 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:54.541783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:849 started Oct 23 01:15:54.544371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3002,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=615000000,duration_sec=1715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:54.545118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:54.545497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:849 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:56.542948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:850 started Oct 23 01:15:56.545472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3004,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=616000000,duration_sec=1717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:56.546080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:56.546451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:850 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:15:58.544474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:851 started Oct 23 01:15:58.547965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3006,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=618000000,duration_sec=1719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:15:58.548692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:15:58.549193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:851 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:16:00.545398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:852 started Oct 23 01:16:00.547891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3008,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=619000000,duration_sec=1721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:00.548497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:00.548892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:852 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:16:02.546465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:853 started Oct 23 01:16:02.549112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee300a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=620000000,duration_sec=1723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:02.550743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:02.551101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:853 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:16:04.547703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:854 started Oct 23 01:16:04.555529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee300c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=621000000,duration_sec=1725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:04.556376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:04.556859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:854 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 23 01:16:06.549429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:855 started Oct 23 01:16:06.553239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee300e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=623000000,duration_sec=1727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:06.554129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:06.554496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:855 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:16:08.550462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:856 started Oct 23 01:16:08.553056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3010,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=624000000,duration_sec=1729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:08.553645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:08.553973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:856 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:16:10.551978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:857 started Oct 23 01:16:10.554521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3012,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=625000000,duration_sec=1731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:10.555103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:10.555545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:857 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 23 01:16:12.553614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:858 started Oct 23 01:16:12.556598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3014,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=627000000,duration_sec=1733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:12.557279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:12.557769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:858 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:16:14.555304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:859 started Oct 23 01:16:14.559715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3016,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=629000000,duration_sec=1735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:14.560583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:14.561180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:859 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:16:16.556109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:860 started Oct 23 01:16:16.559363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee3018,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=630000000,duration_sec=1737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:16.560242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:16.560622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:860 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:16:18.556856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:861 started Oct 23 01:16:18.561084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee301a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=631000000,duration_sec=1739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:18.561873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:18.562354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:861 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 23 01:16:20.558390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:862 started Oct 23 01:16:20.561736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee301c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=632000000,duration_sec=1741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:20.562647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:20.563209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:862 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 23 01:16:22.559372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:863 started Oct 23 01:16:22.563258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x5fee301e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3728779868001237721,duration_nsec=633000000,duration_sec=1743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105573) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 23 01:16:22.564348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: DEBUG neutron.agent.linux.utils [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107335. {{(pid=105573) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 23 01:16:22.565011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105573]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-44b343a0-bf14-4e9a-963f-56c0240bc115 None None] Agent rpc_loop - iteration:863 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006